[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:29 dist-test-slave-xg7f krb5kdc[13674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:29 dist-test-slave-xg7f krb5kdc[13674](info): set up 2 sockets
Sep 23 19:41:29 dist-test-slave-xg7f krb5kdc[13674](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260923 19:41:30.415539 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.002s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:30 dist-test-slave-xg7f krb5kdc[13674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:30.584712 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38257
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:38257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:30.904291 13687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:30.904605 13687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:30.904692 13687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:30.911697 13687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:30.911796 13687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:30.911841 13687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:30.911897 13687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:30.911985 13687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:30.921383 13687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:38257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:30.922677 13687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:30.923966 13687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:30.935899 13692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:30.935972 13693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:30.935940 13695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:30.937003 13687 server_base.cc:1034] running on GCE node
I20260923 19:41:30.937767 13687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:30.939239 13687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:30.940454 13687 hybrid_clock.cc:648] HybridClock initialized: now 1790192490940412 us; error 54 us; skew 500 ppm
I20260923 19:41:30.940798 13687 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:30 dist-test-slave-xg7f krb5kdc[13674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192490, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:30.943780 13687 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:41:30.945088 13687 webserver.cc:460] Webserver started at http://127.13.88.254:38427/ using document root <none> and password file <none>
I20260923 19:41:30.945713 13687 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:30.945803 13687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:30.946044 13687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:30.948869 13687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "ff8590c0ae464591988f394b67c60980"
format_stamp: "Formatted at 2026-09-23 19:41:30 on dist-test-slave-xg7f"
server_key: "cc53e0495d65412ed9357d355d54deba"
server_key_iv: "e699a6e01e87f04f57fd2451b0847efe"
server_key_version: "encryptionkey@0"
I20260923 19:41:30.949530 13687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "ff8590c0ae464591988f394b67c60980"
format_stamp: "Formatted at 2026-09-23 19:41:30 on dist-test-slave-xg7f"
server_key: "cc53e0495d65412ed9357d355d54deba"
server_key_iv: "e699a6e01e87f04f57fd2451b0847efe"
server_key_version: "encryptionkey@0"
I20260923 19:41:30.954377 13687 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260923 19:41:30.957589 13702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:30.958894 13687 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:41:30.959086 13687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "ff8590c0ae464591988f394b67c60980"
format_stamp: "Formatted at 2026-09-23 19:41:30 on dist-test-slave-xg7f"
server_key: "cc53e0495d65412ed9357d355d54deba"
server_key_iv: "e699a6e01e87f04f57fd2451b0847efe"
server_key_version: "encryptionkey@0"
I20260923 19:41:30.959362 13687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:30.976243 13687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:30.980347 13687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:30.980646 13687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:30.999061 13687 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:38257
I20260923 19:41:30.999081 13753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:38257 every 8 connection(s)
I20260923 19:41:31.000491 13687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:31.004127 13754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:31.010738 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 13687
I20260923 19:41:31.011066 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:41:31.013501 13667 external_mini_cluster.cc:1428] Setting key e679ca63774f6b04f31f571f777ef490
I20260923 19:41:31.015651 13754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980: Bootstrap starting.
I20260923 19:41:31.019264 13754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:31.020637 13754 log.cc:824] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:31.023888 13754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980: No bootstrap required, opened a new log
I20260923 19:41:31.034708 13754 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8590c0ae464591988f394b67c60980" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38257 } }
I20260923 19:41:31.035264 13754 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:31.035395 13754 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff8590c0ae464591988f394b67c60980, State: Initialized, Role: FOLLOWER
I20260923 19:41:31.036146 13754 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8590c0ae464591988f394b67c60980" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38257 } }
I20260923 19:41:31.036443 13754 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:31.036580 13754 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:31.036791 13754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:31.039888 13754 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8590c0ae464591988f394b67c60980" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38257 } }
I20260923 19:41:31.040421 13754 leader_election.cc:302] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff8590c0ae464591988f394b67c60980; no voters:
I20260923 19:41:31.041126 13754 leader_election.cc:288] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:31.041242 13759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:31.042469 13759 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [term 1 LEADER]: Becoming Leader. State: Replica: ff8590c0ae464591988f394b67c60980, State: Running, Role: LEADER
I20260923 19:41:31.042974 13759 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8590c0ae464591988f394b67c60980" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38257 } }
I20260923 19:41:31.043367 13754 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:31.046099 13760 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff8590c0ae464591988f394b67c60980" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8590c0ae464591988f394b67c60980" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38257 } } }
I20260923 19:41:31.046329 13761 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff8590c0ae464591988f394b67c60980. Latest consensus state: current_term: 1 leader_uuid: "ff8590c0ae464591988f394b67c60980" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff8590c0ae464591988f394b67c60980" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38257 } } }
I20260923 19:41:31.046619 13760 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:31.046639 13761 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:31.047809 13766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 23 19:41:31 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:31.057189 13766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:31.064589 13756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:31.018074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34568 (local address 127.13.88.254:38257)
0923 19:41:31.020889 (+ 2815us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:31.020899 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:31.020940 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:41:31.034141 (+ 13201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:31.034170 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:31.034634 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:31.034994 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:31.039322 (+ 4328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:31.040807 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:31.043335 (+ 2528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:31.044399 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:31.044611 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:31.053473 (+ 8862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:31.053493 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:31.053520 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:31.053584 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:31.058085 (+ 4501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:31.059282 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:31.059291 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:31.059298 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:31.059512 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:31.060121 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:31.060126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:31.060130 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:31.060776 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:31.061134 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:31.062267 (+ 1133us) server_negotiation.cc:299] Negotiation successful
0923 19:41:31.062677 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2603,"thread_start_us":2361,"threads_started":1}
I20260923 19:41:31.077227 13766 catalog_manager.cc:1347] Generated new cluster ID: 5376d772a2bc4f89a9ee68d21781d24f
I20260923 19:41:31.077356 13766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:31.105937 13766 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:31.107910 13766 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:31.116984 13766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff8590c0ae464591988f394b67c60980: Generated new TSK 0
I20260923 19:41:31.118011 13766 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:41:31.170715 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38257
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:31.490032 13780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:31.490361 13780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:31.490510 13780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:31.497812 13780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:31.497961 13780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:31.498172 13780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:41:31.507767 13780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38257
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:31.509052 13780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:31.510397 13780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:31.523559 13785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:31.523579 13786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:31.523617 13788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:31.524566 13780 server_base.cc:1034] running on GCE node
I20260923 19:41:31.525174 13780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:31.526080 13780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:31.527307 13780 hybrid_clock.cc:648] HybridClock initialized: now 1790192491527263 us; error 56 us; skew 500 ppm
I20260923 19:41:31.527623 13780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:31 dist-test-slave-xg7f krb5kdc[13674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192491, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:31.530596 13780 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:41:31.532207 13780 webserver.cc:460] Webserver started at http://127.13.88.193:37399/ using document root <none> and password file <none>
I20260923 19:41:31.532886 13780 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:31.533025 13780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:31.533332 13780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:31.536211 13780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "1206acb6c8724241b433c56de8c266f5"
format_stamp: "Formatted at 2026-09-23 19:41:31 on dist-test-slave-xg7f"
server_key: "dc3c96f5badd2e4c7ede7a150a31257c"
server_key_iv: "5b8e10ff66b75a4fd0bc73745427f2e6"
server_key_version: "encryptionkey@0"
I20260923 19:41:31.537014 13780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "1206acb6c8724241b433c56de8c266f5"
format_stamp: "Formatted at 2026-09-23 19:41:31 on dist-test-slave-xg7f"
server_key: "dc3c96f5badd2e4c7ede7a150a31257c"
server_key_iv: "5b8e10ff66b75a4fd0bc73745427f2e6"
server_key_version: "encryptionkey@0"
I20260923 19:41:31.542200 13780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:41:31.545832 13795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:31.547222 13780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:41:31.547394 13780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "1206acb6c8724241b433c56de8c266f5"
format_stamp: "Formatted at 2026-09-23 19:41:31 on dist-test-slave-xg7f"
server_key: "dc3c96f5badd2e4c7ede7a150a31257c"
server_key_iv: "5b8e10ff66b75a4fd0bc73745427f2e6"
server_key_version: "encryptionkey@0"
I20260923 19:41:31.547609 13780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:31.568790 13780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:31.573048 13780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:31.573349 13780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:31.574324 13780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:31.575868 13780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:31.575968 13780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:31.576119 13780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:31.576193 13780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:31.609375 13780 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:36677
I20260923 19:41:31.609421 13907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:36677 every 8 connection(s)
I20260923 19:41:31.610773 13780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:41:31.616415 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 13780
I20260923 19:41:31.616669 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:41:31.617266 13667 external_mini_cluster.cc:1428] Setting key f616bcdf90f7046654f4503f201b0f56
Sep 23 19:41:31 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192491, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:41:31.631743 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:31.613415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:41453 (local address 127.13.88.254:38257)
0923 19:41:31.613849 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:31.613854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:31.614831 (+ 977us) server_negotiation.cc:407] Connection header received
0923 19:41:31.617204 (+ 2373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:31.617208 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:31.617279 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:31.617401 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:31.619521 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:31.620225 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:31.621763 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:31.622161 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:31.622293 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:31.626040 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:31.626045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:31.626048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:31.626078 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:31.628631 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:31.629377 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:31.629387 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:31.629390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:31.629504 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:31.629935 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:31.629940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:31.629945 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:31.630216 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:31.630379 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:31.631141 (+ 762us) server_negotiation.cc:299] Negotiation successful
0923 19:41:31.631372 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":222,"threads_started":1}
I20260923 19:41:31.632820 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:31.614008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38257 (local address 127.13.88.193:41453)
0923 19:41:31.614676 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:31.614714 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:31.616716 (+ 2002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:31.617671 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:31.617681 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:31.618414 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:31.619337 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:31.619365 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:31.620374 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:31.620379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:31.621611 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:31.621622 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:31.622391 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:31.622399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:31.622729 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:31.623504 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:31.623546 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:31.625827 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:31.628771 (+ 2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:31.628780 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:31.628798 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:31.629235 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:31.629615 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:31.629621 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:31.629625 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:31.629816 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:31.630354 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:31.630363 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:31.630733 (+ 370us) client_negotiation.cc:769] Sending connection context
0923 19:41:31.631004 (+ 271us) client_negotiation.cc:240] Negotiation successful
0923 19:41:31.631589 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":248,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
I20260923 19:41:31.634454 13908 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38257
I20260923 19:41:31.634819 13908 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:31.635799 13908 heartbeater.cc:511] Master 127.13.88.254:38257 requested a full tablet report, sending...
I20260923 19:41:31.638289 13719 ts_manager.cc:194] Registered new tserver with Master: 1206acb6c8724241b433c56de8c266f5 (127.13.88.193:36677)
I20260923 19:41:31.640085 13719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:41453
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:41:31.654066 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38257
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:31.975726 13914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:31.976068 13914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:31.976228 13914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:31.983480 13914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:31.983639 13914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:31.983821 13914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:41:31.994168 13914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38257
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:31.995532 13914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:31.996838 13914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:32.012961 13919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:32.013322 13920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:32.013334 13922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:32.014533 13914 server_base.cc:1034] running on GCE node
I20260923 19:41:32.015208 13914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:32.016184 13914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:32.017436 13914 hybrid_clock.cc:648] HybridClock initialized: now 1790192492017390 us; error 62 us; skew 500 ppm
I20260923 19:41:32.017802 13914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:32.020905 13914 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:41:32.022254 13914 webserver.cc:460] Webserver started at http://127.13.88.194:37871/ using document root <none> and password file <none>
I20260923 19:41:32.022915 13914 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:32.023015 13914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:32.023347 13914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:32.026139 13914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "c1b265b412a644c99e54040d7513579c"
format_stamp: "Formatted at 2026-09-23 19:41:32 on dist-test-slave-xg7f"
server_key: "8763a5a9731c811c35acfbbdac8802ef"
server_key_iv: "1181c018b0d734c97fbb953a0960d443"
server_key_version: "encryptionkey@0"
I20260923 19:41:32.026847 13914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "c1b265b412a644c99e54040d7513579c"
format_stamp: "Formatted at 2026-09-23 19:41:32 on dist-test-slave-xg7f"
server_key: "8763a5a9731c811c35acfbbdac8802ef"
server_key_iv: "1181c018b0d734c97fbb953a0960d443"
server_key_version: "encryptionkey@0"
I20260923 19:41:32.031894 13914 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:41:32.035285 13929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:32.036604 13914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:41:32.036726 13914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "c1b265b412a644c99e54040d7513579c"
format_stamp: "Formatted at 2026-09-23 19:41:32 on dist-test-slave-xg7f"
server_key: "8763a5a9731c811c35acfbbdac8802ef"
server_key_iv: "1181c018b0d734c97fbb953a0960d443"
server_key_version: "encryptionkey@0"
I20260923 19:41:32.036888 13914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:32.065835 13914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:32.069733 13914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:32.069999 13914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:32.070909 13914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:32.072227 13914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:32.072300 13914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:32.072404 13914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:32.072448 13914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:32.105273 13914 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:38365
I20260923 19:41:32.105319 14041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:38365 every 8 connection(s)
I20260923 19:41:32.106595 13914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:41:32.111325 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 13914
I20260923 19:41:32.111519 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:41:32.111934 13667 external_mini_cluster.cc:1428] Setting key ad498f835936ab361f86d19786a228c5
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:41:32.128023 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.109142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:42987 (local address 127.13.88.254:38257)
0923 19:41:32.109320 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:32.109324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:32.110493 (+ 1169us) server_negotiation.cc:407] Connection header received
0923 19:41:32.112519 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:32.112525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:32.112615 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:32.112745 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:32.114401 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.115622 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.117226 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.118013 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.118121 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.122232 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:32.122236 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:32.122239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:32.122270 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:32.124893 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.125643 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.125651 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.125660 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.125778 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.126207 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.126212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.126215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.126489 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:32.126662 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:32.127439 (+ 777us) server_negotiation.cc:299] Negotiation successful
0923 19:41:32.127669 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:41:32.129067 14044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.109647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38257 (local address 127.13.88.194:42987)
0923 19:41:32.110342 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:32.110381 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:32.112241 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:32.112967 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:32.112975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:32.113498 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:32.114210 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:32.114228 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.115762 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.115766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:32.117045 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:32.117059 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.118270 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.118277 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:32.118587 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.119368 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:32.119406 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:32.121993 (+ 2587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:32.125046 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:32.125054 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:32.125071 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:32.125511 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:32.125888 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:32.125893 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:32.125897 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:32.126088 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:32.126625 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:32.126635 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:32.126992 (+ 357us) client_negotiation.cc:769] Sending connection context
0923 19:41:32.127342 (+ 350us) client_negotiation.cc:240] Negotiation successful
0923 19:41:32.127881 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":269,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
I20260923 19:41:32.130545 14042 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38257
I20260923 19:41:32.130852 14042 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:32.131773 14042 heartbeater.cc:511] Master 127.13.88.254:38257 requested a full tablet report, sending...
I20260923 19:41:32.133447 13719 ts_manager.cc:194] Registered new tserver with Master: c1b265b412a644c99e54040d7513579c (127.13.88.194:38365)
I20260923 19:41:32.134232 13719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:42987
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:41:32.149600 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38257
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:32.466670 14047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:32.466943 14047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:32.467034 14047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:32.474213 14047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:32.474318 14047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:32.474431 14047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:41:32.484233 14047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38257
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:32.485442 14047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:32.486668 14047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:32.499953 14052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:32.500041 14055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:32.499991 14053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:32.500916 14047 server_base.cc:1034] running on GCE node
I20260923 19:41:32.501550 14047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:32.502544 14047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:32.503769 14047 hybrid_clock.cc:648] HybridClock initialized: now 1790192492503710 us; error 51 us; skew 500 ppm
I20260923 19:41:32.504086 14047 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:32.507205 14047 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:41:32.508728 14047 webserver.cc:460] Webserver started at http://127.13.88.195:39095/ using document root <none> and password file <none>
I20260923 19:41:32.509428 14047 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:32.509574 14047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:32.509902 14047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:32.512858 14047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "bc2da556689c4c31a916bd83f2ed34cc"
format_stamp: "Formatted at 2026-09-23 19:41:32 on dist-test-slave-xg7f"
server_key: "ba19abe3dc3f133393b790f88f0d15ab"
server_key_iv: "f23224cd53eaabecfdc5e776f0738043"
server_key_version: "encryptionkey@0"
I20260923 19:41:32.513603 14047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "bc2da556689c4c31a916bd83f2ed34cc"
format_stamp: "Formatted at 2026-09-23 19:41:32 on dist-test-slave-xg7f"
server_key: "ba19abe3dc3f133393b790f88f0d15ab"
server_key_iv: "f23224cd53eaabecfdc5e776f0738043"
server_key_version: "encryptionkey@0"
I20260923 19:41:32.518699 14047 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:41:32.522166 14062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:32.523532 14047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:41:32.523723 14047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "bc2da556689c4c31a916bd83f2ed34cc"
format_stamp: "Formatted at 2026-09-23 19:41:32 on dist-test-slave-xg7f"
server_key: "ba19abe3dc3f133393b790f88f0d15ab"
server_key_iv: "f23224cd53eaabecfdc5e776f0738043"
server_key_version: "encryptionkey@0"
I20260923 19:41:32.523923 14047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:32.548413 14047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:32.552810 14047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:32.553107 14047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:32.554108 14047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:32.555541 14047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:32.555644 14047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:32.555787 14047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:32.555859 14047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:32.588985 14047 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:33775
I20260923 19:41:32.589027 14174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:33775 every 8 connection(s)
I20260923 19:41:32.590260 14047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:41:32.596184 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 14047
I20260923 19:41:32.596386 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:41:32.596814 13667 external_mini_cluster.cc:1428] Setting key 903381c9f6153919b99dbad2a5273f81
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:32.609973 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.592938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:33211 (local address 127.13.88.254:38257)
0923 19:41:32.593125 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:32.593129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:32.594224 (+ 1095us) server_negotiation.cc:407] Connection header received
0923 19:41:32.596084 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:32.596090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:32.596214 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:32.596330 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:32.598020 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.598976 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.600657 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.601037 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.601163 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.604445 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:32.604450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:32.604453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:32.604481 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:32.606908 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.607633 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.607642 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.607644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.607759 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.608198 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.608204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.608210 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.608470 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:32.608625 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:32.609387 (+ 762us) server_negotiation.cc:299] Negotiation successful
0923 19:41:32.609603 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:41:32.610670 14177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.593381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38257 (local address 127.13.88.195:33211)
0923 19:41:32.594056 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:32.594101 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:32.595817 (+ 1716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:32.596614 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:32.596622 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:32.597196 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:32.597848 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:32.597867 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.599154 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.599158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:32.600512 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:32.600530 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.601263 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.601270 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:32.601518 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.602141 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:32.602161 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:32.604234 (+ 2073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:32.607038 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:32.607048 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:32.607064 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:32.607502 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:32.607865 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:32.607870 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:32.607874 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:32.608069 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:32.608620 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:32.608625 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:32.608972 (+ 347us) client_negotiation.cc:769] Sending connection context
0923 19:41:32.609233 (+ 261us) client_negotiation.cc:240] Negotiation successful
0923 19:41:32.609593 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":264,"threads_started":1}
I20260923 19:41:32.612303 14175 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38257
I20260923 19:41:32.612613 14175 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:32.613420 14175 heartbeater.cc:511] Master 127.13.88.254:38257 requested a full tablet report, sending...
I20260923 19:41:32.614939 13719 ts_manager.cc:194] Registered new tserver with Master: bc2da556689c4c31a916bd83f2ed34cc (127.13.88.195:33775)
I20260923 19:41:32.615792 13719 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:33211
I20260923 19:41:32.625187 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:41:32.643277 13908 heartbeater.cc:503] Master 127.13.88.254:38257 was elected leader, sending a full tablet report...
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:32.668110 14182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.653438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60752 (local address 127.13.88.193:36677)
0923 19:41:32.654115 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:32.654122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:32.654148 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:41:32.654210 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:32.654216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:32.654435 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:32.654582 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:32.655967 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.656955 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.658132 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.658686 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.658776 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.662516 (+ 3740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:32.662526 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:32.662540 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:32.662573 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:32.665656 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.666242 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.666248 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.666250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.666369 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.666711 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.666714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.666716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.667022 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:32.667305 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:32.667525 (+ 220us) server_negotiation.cc:299] Negotiation successful
0923 19:41:32.667709 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":373,"threads_started":1}
W20260923 19:41:32.669394 13823 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60752
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:32.710803 14182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.697882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60768 (local address 127.13.88.193:36677)
0923 19:41:32.698110 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:32.698116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:32.698283 (+ 167us) server_negotiation.cc:407] Connection header received
0923 19:41:32.698429 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:32.698433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:32.698521 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:32.698608 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:32.699936 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.700612 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.701748 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.702179 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.702265 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.705904 (+ 3639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:32.705908 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:32.705912 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:32.705943 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:32.708573 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.709275 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.709278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.709281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.709390 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.709682 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.709685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.709687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.709910 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:32.710073 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:32.710326 (+ 253us) server_negotiation.cc:299] Negotiation successful
0923 19:41:32.710474 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:41:32.712381 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 13780
I20260923 19:41:32.724650 14182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.713401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60774 (local address 127.13.88.193:36677)
0923 19:41:32.713634 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:32.713639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:32.713821 (+ 182us) server_negotiation.cc:407] Connection header received
0923 19:41:32.713986 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:32.713991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:32.714049 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:32.714162 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:32.715314 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.716030 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.717247 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.717647 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.717776 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.719934 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:32.719939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:32.719942 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:32.719968 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:32.722130 (+ 2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.722736 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.722743 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.722747 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.722887 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.723294 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.723300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.723303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.723541 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:32.723796 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:32.724101 (+ 305us) server_negotiation.cc:299] Negotiation successful
0923 19:41:32.724296 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:41:32.725425 13903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:32.808386 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 13780
I20260923 19:41:32.824292 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 13914
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:41:32.840054 14189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.825194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57718 (local address 127.13.88.194:38365)
0923 19:41:32.825734 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:32.825741 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:32.825765 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:41:32.825822 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:32.825828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:32.826037 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:32.826202 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:32.827559 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.828660 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.829886 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.830407 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.830551 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.834469 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:32.834479 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:32.834494 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:32.834539 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:32.837220 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.837857 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.837864 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.837866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.837994 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.838387 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.838396 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.838398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.838734 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:32.839020 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:32.839446 (+ 426us) server_negotiation.cc:299] Negotiation successful
0923 19:41:32.839661 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":281,"threads_started":1}
I20260923 19:41:32.841307 14037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:32.925794 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 13914
I20260923 19:41:32.941732 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14047
Sep 23 19:41:32 dist-test-slave-xg7f krb5kdc[13674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:41:32.957942 14191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:32.942741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37654 (local address 127.13.88.195:33775)
0923 19:41:32.943461 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:32.943468 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:32.943497 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:41:32.943562 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:32.943567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:32.943843 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:32.944023 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:32.945412 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.946434 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.947850 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:32.948410 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:32.948549 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:32.952560 (+ 4011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:32.952570 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:32.952584 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:32.952617 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:32.955243 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.955909 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.955916 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.955919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.956038 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:32.956382 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:32.956389 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:32.956391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:32.956736 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:32.957053 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:32.957316 (+ 263us) server_negotiation.cc:299] Negotiation successful
0923 19:41:32.957584 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":373,"threads_started":1}
I20260923 19:41:32.959340 14170 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:33.042858 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 14047
I20260923 19:41:33.058375 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 13687
I20260923 19:41:33.059594 13749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:33.160804 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 13687
2026-09-23T19:41:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3833 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:33 dist-test-slave-xg7f krb5kdc[14196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:33 dist-test-slave-xg7f krb5kdc[14196](info): set up 2 sockets
Sep 23 19:41:33 dist-test-slave-xg7f krb5kdc[14196](info): commencing operation
krb5kdc: starting...
W20260923 19:41:34.231012 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.003s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:34 dist-test-slave-xg7f krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:34.400427 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:46845
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:46845
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:34.714540 14209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:34.714813 14209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:34.714900 14209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:34.722074 14209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:34.722177 14209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:34.722229 14209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:34.722308 14209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:34.722370 14209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:34.732010 14209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:46845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:46845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:34.733314 14209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:34.734623 14209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:34.745862 14217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:34.745922 14214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:34.745947 14215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:34.746881 14209 server_base.cc:1034] running on GCE node
I20260923 19:41:34.747754 14209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:34.749178 14209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:34.750387 14209 hybrid_clock.cc:648] HybridClock initialized: now 1790192494750336 us; error 37 us; skew 500 ppm
I20260923 19:41:34.750677 14209 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:34 dist-test-slave-xg7f krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192494, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:34.757104 14209 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:41:34.758656 14209 webserver.cc:460] Webserver started at http://127.13.88.254:38191/ using document root <none> and password file <none>
I20260923 19:41:34.759414 14209 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:34.759548 14209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:34.759871 14209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:34.762835 14209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "3407598050e64b06add21329c3fa9de9"
format_stamp: "Formatted at 2026-09-23 19:41:34 on dist-test-slave-xg7f"
server_key: "cdd701126a669568452e50439495b2f3"
server_key_iv: "ce55e95222565a9332670bef136f20fe"
server_key_version: "encryptionkey@0"
I20260923 19:41:34.763682 14209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "3407598050e64b06add21329c3fa9de9"
format_stamp: "Formatted at 2026-09-23 19:41:34 on dist-test-slave-xg7f"
server_key: "cdd701126a669568452e50439495b2f3"
server_key_iv: "ce55e95222565a9332670bef136f20fe"
server_key_version: "encryptionkey@0"
I20260923 19:41:34.769138 14209 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:41:34.772706 14224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:34.774089 14209 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:41:34.774279 14209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "3407598050e64b06add21329c3fa9de9"
format_stamp: "Formatted at 2026-09-23 19:41:34 on dist-test-slave-xg7f"
server_key: "cdd701126a669568452e50439495b2f3"
server_key_iv: "ce55e95222565a9332670bef136f20fe"
server_key_version: "encryptionkey@0"
I20260923 19:41:34.774485 14209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:34.789345 14209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:34.793310 14209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:34.793619 14209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:34.811442 14209 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:46845
I20260923 19:41:34.811461 14275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:46845 every 8 connection(s)
I20260923 19:41:34.812839 14209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:34.816636 14276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:34.817546 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 14209
I20260923 19:41:34.817800 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:41:34.818646 13667 external_mini_cluster.cc:1428] Setting key e7fd2b38404cbf426f047a69bebf98d9
I20260923 19:41:34.829290 14276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9: Bootstrap starting.
Sep 23 19:41:34 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:34.832666 14276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:34.833750 14276 log.cc:824] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:34.836664 14276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9: No bootstrap required, opened a new log
I20260923 19:41:34.840567 14279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:34.820752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39220 (local address 127.13.88.254:46845)
0923 19:41:34.821470 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:34.821482 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:34.821521 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:41:34.823256 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:34.823277 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:34.823656 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:34.824070 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:34.825522 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:34.826830 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:34.828127 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:34.828787 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:34.828984 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:34.833141 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:34.833149 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:34.833164 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:34.833199 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:34.836176 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:34.836835 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:34.836843 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:34.836850 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:34.837056 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:34.837395 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:34.837403 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:34.837405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:34.838068 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:34.838348 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:34.838759 (+ 411us) server_negotiation.cc:299] Negotiation successful
0923 19:41:34.839221 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":318,"threads_started":1}
I20260923 19:41:34.845904 14276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3407598050e64b06add21329c3fa9de9" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46845 } }
I20260923 19:41:34.846244 14276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:34.846341 14276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3407598050e64b06add21329c3fa9de9, State: Initialized, Role: FOLLOWER
I20260923 19:41:34.846874 14276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3407598050e64b06add21329c3fa9de9" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46845 } }
I20260923 19:41:34.847075 14276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:34.847240 14276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:34.847359 14276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:34.849493 14276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3407598050e64b06add21329c3fa9de9" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46845 } }
I20260923 19:41:34.850009 14276 leader_election.cc:302] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3407598050e64b06add21329c3fa9de9; no voters:
I20260923 19:41:34.850524 14276 leader_election.cc:288] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:34.850666 14281 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:34.851325 14281 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [term 1 LEADER]: Becoming Leader. State: Replica: 3407598050e64b06add21329c3fa9de9, State: Running, Role: LEADER
I20260923 19:41:34.851878 14281 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3407598050e64b06add21329c3fa9de9" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46845 } }
I20260923 19:41:34.852571 14276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:34.854631 14282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3407598050e64b06add21329c3fa9de9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3407598050e64b06add21329c3fa9de9" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46845 } } }
I20260923 19:41:34.854573 14283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3407598050e64b06add21329c3fa9de9. Latest consensus state: current_term: 1 leader_uuid: "3407598050e64b06add21329c3fa9de9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3407598050e64b06add21329c3fa9de9" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46845 } } }
I20260923 19:41:34.855091 14282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:34.855091 14283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:34.856892 14287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:34.861938 14287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:34.870554 14287 catalog_manager.cc:1347] Generated new cluster ID: dd13ed39a25f4e32960b82350777c319
I20260923 19:41:34.870673 14287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:34.890645 14287 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:34.892030 14287 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:34.903339 14287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3407598050e64b06add21329c3fa9de9: Generated new TSK 0
I20260923 19:41:34.904203 14287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:41:34.945945 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:46845
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:35.264505 14302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:35.264797 14302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:35.264926 14302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:35.271927 14302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:35.272095 14302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:35.272276 14302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:41:35.282052 14302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:46845
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:35.283398 14302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:35.284785 14302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:35.297837 14310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:35.297866 14307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:35.297904 14308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:35.298681 14302 server_base.cc:1034] running on GCE node
I20260923 19:41:35.299324 14302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:35.300308 14302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:35.301527 14302 hybrid_clock.cc:648] HybridClock initialized: now 1790192495301455 us; error 87 us; skew 500 ppm
I20260923 19:41:35.301797 14302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:35 dist-test-slave-xg7f krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192495, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:35.304960 14302 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:41:35.306294 14302 webserver.cc:460] Webserver started at http://127.13.88.193:40309/ using document root <none> and password file <none>
I20260923 19:41:35.306936 14302 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:35.307029 14302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:35.307363 14302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:35.310168 14302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "83c33a67b6ce43969d8079ff9e4df26a"
format_stamp: "Formatted at 2026-09-23 19:41:35 on dist-test-slave-xg7f"
server_key: "6986446da6f3f2ca564d25eb5acbd99e"
server_key_iv: "6e2fec1a94781db5ffa0360d8e8455e3"
server_key_version: "encryptionkey@0"
I20260923 19:41:35.310890 14302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "83c33a67b6ce43969d8079ff9e4df26a"
format_stamp: "Formatted at 2026-09-23 19:41:35 on dist-test-slave-xg7f"
server_key: "6986446da6f3f2ca564d25eb5acbd99e"
server_key_iv: "6e2fec1a94781db5ffa0360d8e8455e3"
server_key_version: "encryptionkey@0"
I20260923 19:41:35.315868 14302 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:41:35.319278 14317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:35.320587 14302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:41:35.320745 14302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "83c33a67b6ce43969d8079ff9e4df26a"
format_stamp: "Formatted at 2026-09-23 19:41:35 on dist-test-slave-xg7f"
server_key: "6986446da6f3f2ca564d25eb5acbd99e"
server_key_iv: "6e2fec1a94781db5ffa0360d8e8455e3"
server_key_version: "encryptionkey@0"
I20260923 19:41:35.320938 14302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:35.336848 14302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:35.341274 14302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:35.341583 14302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:35.342674 14302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:35.344069 14302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:35.344165 14302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:35.344321 14302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:35.344411 14302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:35.376827 14302 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:40681
I20260923 19:41:35.376866 14429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:40681 every 8 connection(s)
I20260923 19:41:35.378188 14302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:41:35.382699 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 14302
I20260923 19:41:35.382917 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:41:35.383702 13667 external_mini_cluster.cc:1428] Setting key 43ac6e478cd9d8e07c670fc170e1f3b4
Sep 23 19:41:35 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192495, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:41:35.399302 14432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:35.380582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:41809 (local address 127.13.88.254:46845)
0923 19:41:35.381030 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:35.381035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:35.381802 (+ 767us) server_negotiation.cc:407] Connection header received
0923 19:41:35.384442 (+ 2640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:35.384447 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:35.384533 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:35.384664 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:35.386288 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.386993 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.389440 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.389848 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.389990 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:35.393618 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:35.393623 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:35.393627 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:35.393657 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:35.396257 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:35.396976 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:35.396988 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:35.396990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:35.397102 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:35.397525 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:35.397530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:35.397533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:35.397890 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:35.398051 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:35.398711 (+ 660us) server_negotiation.cc:299] Negotiation successful
0923 19:41:35.398921 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":228,"threads_started":1}
I20260923 19:41:35.400321 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:35.381012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:46845 (local address 127.13.88.193:41809)
0923 19:41:35.381650 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:35.381691 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:35.384123 (+ 2432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:35.384900 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:35.384908 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:35.385382 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:35.386107 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:35.386131 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.387181 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.387190 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:35.389295 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:35.389311 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.390083 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.390091 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:35.390312 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:35.391026 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:35.391047 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:35.393392 (+ 2345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:35.396414 (+ 3022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:35.396425 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:35.396440 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:35.396843 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:35.397210 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:35.397215 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:35.397219 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:35.397409 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:35.398047 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:35.398054 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:35.398370 (+ 316us) client_negotiation.cc:769] Sending connection context
0923 19:41:35.398622 (+ 252us) client_negotiation.cc:240] Negotiation successful
0923 19:41:35.399174 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":247,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
I20260923 19:41:35.401932 14430 heartbeater.cc:347] Connected to a master server at 127.13.88.254:46845
I20260923 19:41:35.402254 14430 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:35.403239 14430 heartbeater.cc:511] Master 127.13.88.254:46845 requested a full tablet report, sending...
I20260923 19:41:35.405517 14241 ts_manager.cc:194] Registered new tserver with Master: 83c33a67b6ce43969d8079ff9e4df26a (127.13.88.193:40681)
I20260923 19:41:35.406960 14241 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:41809
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:41:35.421670 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:46845
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:35.737005 14436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:35.737319 14436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:35.737489 14436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:35.744421 14436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:35.744560 14436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:35.744742 14436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:41:35.754591 14436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:46845
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:35.755934 14436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:35.757270 14436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:35.770048 14441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:35.770131 14444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:35.770159 14442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:35.770962 14436 server_base.cc:1034] running on GCE node
I20260923 19:41:35.771574 14436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:35.772466 14436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:35.773670 14436 hybrid_clock.cc:648] HybridClock initialized: now 1790192495773610 us; error 49 us; skew 500 ppm
I20260923 19:41:35.773996 14436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:35 dist-test-slave-xg7f krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192495, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:35.777827 14436 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:41:35.779794 14436 webserver.cc:460] Webserver started at http://127.13.88.194:33937/ using document root <none> and password file <none>
I20260923 19:41:35.780515 14436 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:35.780651 14436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:35.780988 14436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:35.784432 14436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "a3725bfe6d264d40bb01e38032bb1658"
format_stamp: "Formatted at 2026-09-23 19:41:35 on dist-test-slave-xg7f"
server_key: "b4da30cd905198b5526cd1ebaa889a91"
server_key_iv: "8c645c2b24c9e00a6f27959d0fa0c4a2"
server_key_version: "encryptionkey@0"
I20260923 19:41:35.785204 14436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "a3725bfe6d264d40bb01e38032bb1658"
format_stamp: "Formatted at 2026-09-23 19:41:35 on dist-test-slave-xg7f"
server_key: "b4da30cd905198b5526cd1ebaa889a91"
server_key_iv: "8c645c2b24c9e00a6f27959d0fa0c4a2"
server_key_version: "encryptionkey@0"
I20260923 19:41:35.790082 14436 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:41:35.793412 14451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:35.794695 14436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:35.794866 14436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "a3725bfe6d264d40bb01e38032bb1658"
format_stamp: "Formatted at 2026-09-23 19:41:35 on dist-test-slave-xg7f"
server_key: "b4da30cd905198b5526cd1ebaa889a91"
server_key_iv: "8c645c2b24c9e00a6f27959d0fa0c4a2"
server_key_version: "encryptionkey@0"
I20260923 19:41:35.795064 14436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:35.813445 14436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:35.817838 14436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:35.818156 14436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:35.819312 14436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:35.820703 14436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:35.820806 14436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:35.820960 14436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:35.821031 14436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:35.854825 14436 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:32983
I20260923 19:41:35.854869 14563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:32983 every 8 connection(s)
I20260923 19:41:35.856154 14436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:41:35.857784 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 14436
I20260923 19:41:35.857970 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:41:35.858476 13667 external_mini_cluster.cc:1428] Setting key 9ef01ae7ba7bb29f7846fbc180a2b0bb
Sep 23 19:41:35 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192495, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
I20260923 19:41:35.877683 14432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:35.858813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:52873 (local address 127.13.88.254:46845)
0923 19:41:35.859837 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:35.859845 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:35.860297 (+ 452us) server_negotiation.cc:407] Connection header received
0923 19:41:35.862176 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:35.862193 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:35.862284 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:35.862391 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:35.864001 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.864732 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.866267 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.866661 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.866795 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:35.870803 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:35.870812 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:35.870820 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:35.870870 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:35.874426 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:35.875252 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:35.875256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:35.875259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:35.875456 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:35.875832 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:35.875836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:35.875837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:35.876112 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:35.876340 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:35.877131 (+ 791us) server_negotiation.cc:299] Negotiation successful
0923 19:41:35.877353 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":857}
I20260923 19:41:35.878669 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:35.859396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:46845 (local address 127.13.88.194:52873)
0923 19:41:35.860156 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:35.860202 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:35.861885 (+ 1683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:35.862662 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:35.862670 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:35.863258 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:35.863837 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:35.863854 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.864899 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.864903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:35.866117 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:35.866128 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:35.866887 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:35.866896 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:35.867188 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:35.867866 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:35.867893 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:35.870560 (+ 2667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:35.874587 (+ 4027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:35.874596 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:35.874617 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:35.875078 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:35.875549 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:35.875552 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:35.875554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:35.875724 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:35.876304 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:35.876314 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:35.876709 (+ 395us) client_negotiation.cc:769] Sending connection context
0923 19:41:35.877031 (+ 322us) client_negotiation.cc:240] Negotiation successful
0923 19:41:35.877565 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":386,"threads_started":1}
I20260923 19:41:35.880352 14564 heartbeater.cc:347] Connected to a master server at 127.13.88.254:46845
I20260923 19:41:35.880668 14564 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:35.881369 14564 heartbeater.cc:511] Master 127.13.88.254:46845 requested a full tablet report, sending...
I20260923 19:41:35.882869 14241 ts_manager.cc:194] Registered new tserver with Master: a3725bfe6d264d40bb01e38032bb1658 (127.13.88.194:32983)
I20260923 19:41:35.883721 14241 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:52873
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:41:35.896425 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:46845
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:36.208948 14569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:36.209208 14569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:36.209311 14569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:36.216300 14569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:36.216387 14569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:36.216535 14569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:41:36.225709 14569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:46845
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:36.226853 14569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:36.228132 14569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:36.240429 14574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:36.240470 14575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:36.240530 14577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:36.241041 14569 server_base.cc:1034] running on GCE node
I20260923 19:41:36.241602 14569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:36.242488 14569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:36.243700 14569 hybrid_clock.cc:648] HybridClock initialized: now 1790192496243666 us; error 29 us; skew 500 ppm
I20260923 19:41:36.244007 14569 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:36.246977 14569 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:41:36.248317 14569 webserver.cc:460] Webserver started at http://127.13.88.195:38695/ using document root <none> and password file <none>
I20260923 19:41:36.248893 14569 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:36.249015 14569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:36.249257 14569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:36.251888 14569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "04a0e9f20b384285b9f837969d61c04a"
format_stamp: "Formatted at 2026-09-23 19:41:36 on dist-test-slave-xg7f"
server_key: "b5a36a75fd60b226ce63a2a41f3841bd"
server_key_iv: "0253b7c24e4f3890d0851f6ad3794b10"
server_key_version: "encryptionkey@0"
I20260923 19:41:36.252616 14569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "04a0e9f20b384285b9f837969d61c04a"
format_stamp: "Formatted at 2026-09-23 19:41:36 on dist-test-slave-xg7f"
server_key: "b5a36a75fd60b226ce63a2a41f3841bd"
server_key_iv: "0253b7c24e4f3890d0851f6ad3794b10"
server_key_version: "encryptionkey@0"
I20260923 19:41:36.257246 14569 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:41:36.260517 14584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:36.261682 14569 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 19:41:36.261835 14569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "04a0e9f20b384285b9f837969d61c04a"
format_stamp: "Formatted at 2026-09-23 19:41:36 on dist-test-slave-xg7f"
server_key: "b5a36a75fd60b226ce63a2a41f3841bd"
server_key_iv: "0253b7c24e4f3890d0851f6ad3794b10"
server_key_version: "encryptionkey@0"
I20260923 19:41:36.262009 14569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:36.279767 14569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:36.283744 14569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:36.284013 14569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:36.284880 14569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:36.286131 14569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:36.286202 14569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:36.286379 14569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:36.286427 14569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:36.318554 14569 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:34661
I20260923 19:41:36.318603 14696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:34661 every 8 connection(s)
I20260923 19:41:36.319931 14569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:41:36.323846 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 14569
I20260923 19:41:36.324069 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:41:36.324635 13667 external_mini_cluster.cc:1428] Setting key 9f89405fd74a980ce449888e35126b97
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:36.339563 14432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.322459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:53827 (local address 127.13.88.254:46845)
0923 19:41:36.322651 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.322656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.323957 (+ 1301us) server_negotiation.cc:407] Connection header received
0923 19:41:36.326437 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.326442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.326536 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.326618 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.328337 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.329050 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.330507 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.330894 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.330983 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.334253 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.334257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.334260 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.334288 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.336703 (+ 2415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.337332 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.337336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.337339 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.337452 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.337791 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.337794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.337796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.338042 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.338187 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.338965 (+ 778us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.339219 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:41:36.340646 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.322922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:46845 (local address 127.13.88.195:53827)
0923 19:41:36.323760 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:36.323825 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:36.326134 (+ 2309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:36.326880 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:36.326887 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:36.327560 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:36.328196 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.328213 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.329196 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.329199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.330381 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.330392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.331072 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.331076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.331345 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.332028 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:36.332054 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:36.334083 (+ 2029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:36.336819 (+ 2736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:36.336825 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:36.336837 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:36.337226 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:36.337538 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:36.337541 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:36.337543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:36.337700 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:36.338178 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:36.338184 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:36.338565 (+ 381us) client_negotiation.cc:769] Sending connection context
0923 19:41:36.338859 (+ 294us) client_negotiation.cc:240] Negotiation successful
0923 19:41:36.339429 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":323,"threads_started":1}
I20260923 19:41:36.341934 14697 heartbeater.cc:347] Connected to a master server at 127.13.88.254:46845
I20260923 19:41:36.342206 14697 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:36.342849 14697 heartbeater.cc:511] Master 127.13.88.254:46845 requested a full tablet report, sending...
I20260923 19:41:36.344252 14241 ts_manager.cc:194] Registered new tserver with Master: 04a0e9f20b384285b9f837969d61c04a (127.13.88.195:34661)
I20260923 19:41:36.345012 14241 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:53827
I20260923 19:41:36.352257 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:41:36.369973 14432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.358398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39224 (local address 127.13.88.254:46845)
0923 19:41:36.358558 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.358562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.359014 (+ 452us) server_negotiation.cc:407] Connection header received
0923 19:41:36.359203 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.359206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.359269 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.359346 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.360818 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.361510 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.362673 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.363053 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.363234 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.365411 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.365418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.365423 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.365460 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.367933 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.368486 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.368490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.368492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.368610 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.368897 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.368900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.368902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.369178 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.369343 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.369613 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.369756 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 19:41:36.375921 14241 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:41:36.386102 14241 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:36.407559 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.397771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33938 (local address 127.13.88.193:40681)
0923 19:41:36.400146 (+ 2375us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.400156 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.400185 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:41:36.400274 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.400281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.400471 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.400665 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:36.401280 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.402904 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.405350 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.406335 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.406497 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.406747 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.407024 (+ 277us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.407230 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2216,"thread_start_us":2335,"threads_started":1}
I20260923 19:41:36.407635 14709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.397606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40681 (local address 127.0.0.1:33938)
0923 19:41:36.398613 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:36.398669 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:36.398871 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:36.400668 (+ 1797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:36.400674 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:36.400701 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:36.401085 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.401100 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.403132 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.403139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.405158 (+ 2019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.405170 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.406564 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.406571 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.406784 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.406841 (+ 57us) client_negotiation.cc:769] Sending connection context
0923 19:41:36.406981 (+ 140us) client_negotiation.cc:240] Negotiation successful
0923 19:41:36.407180 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"mutex_wait_us":21,"thread_start_us":525,"threads_started":1}
I20260923 19:41:36.410442 14713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.398976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:34661 (local address 127.0.0.1:58798)
0923 19:41:36.401747 (+ 2771us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:36.401762 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:36.401868 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:36.402684 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:36.402689 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:36.402710 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:36.403267 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.403278 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.405222 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.405228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.407841 (+ 2613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.407854 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.409583 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.409589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.409763 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.409796 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 19:41:36.409901 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:41:36.410033 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2650,"mutex_wait_us":102,"thread_start_us":2511,"threads_started":1}
I20260923 19:41:36.410421 14430 heartbeater.cc:503] Master 127.13.88.254:46845 was elected leader, sending a full tablet report...
I20260923 19:41:36.411290 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.399567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.13.88.195:34661)
0923 19:41:36.401334 (+ 1767us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.401343 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.401973 (+ 630us) server_negotiation.cc:407] Connection header received
0923 19:41:36.402070 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.402077 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.402268 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.402443 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:36.403434 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.405019 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.408007 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.409380 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.409526 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.409742 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.410808 (+ 1066us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.410962 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1607,"thread_start_us":1467,"threads_started":1}
I20260923 19:41:36.411361 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.398302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48048 (local address 127.13.88.194:32983)
0923 19:41:36.402230 (+ 3928us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.402240 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.402267 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:41:36.402361 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.402369 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.402597 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.402800 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:36.403697 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.405222 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.408282 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.409695 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.409876 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.410046 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.410860 (+ 814us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.411006 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3779,"thread_start_us":4208,"threads_started":1}
I20260923 19:41:36.410737 14710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.397756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:32983 (local address 127.0.0.1:48048)
0923 19:41:36.399513 (+ 1757us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:36.399530 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:36.399643 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:36.402805 (+ 3162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:36.402809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:36.402837 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:36.403495 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.403506 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.405384 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.405389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.408132 (+ 2743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.408144 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.409954 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.409960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.410118 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.410158 (+ 40us) client_negotiation.cc:769] Sending connection context
0923 19:41:36.410253 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 19:41:36.410378 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1615,"mutex_wait_us":61,"thread_start_us":1461,"threads_started":1}
I20260923 19:41:36.411712 14365 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb6ceded1c54703a8d901c748627702 (DEFAULT_TABLE table=test-table [id=eecdc0f7a2b747da85bac85ee741de89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:36.414837 14632 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb6ceded1c54703a8d901c748627702 (DEFAULT_TABLE table=test-table [id=eecdc0f7a2b747da85bac85ee741de89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:36.414885 14499 tablet_service.cc:1467] Processing CreateTablet for tablet 0bb6ceded1c54703a8d901c748627702 (DEFAULT_TABLE table=test-table [id=eecdc0f7a2b747da85bac85ee741de89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:36.415761 14365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb6ceded1c54703a8d901c748627702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:36.416059 14499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb6ceded1c54703a8d901c748627702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:36.416131 14632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0bb6ceded1c54703a8d901c748627702. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:36.426855 14715 tablet_bootstrap.cc:492] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658: Bootstrap starting.
I20260923 19:41:36.429929 14716 tablet_bootstrap.cc:492] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a: Bootstrap starting.
I20260923 19:41:36.430575 14715 tablet_bootstrap.cc:654] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:36.431824 14717 tablet_bootstrap.cc:492] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a: Bootstrap starting.
I20260923 19:41:36.432050 14715 log.cc:824] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:36.433929 14716 tablet_bootstrap.cc:654] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:36.435091 14717 tablet_bootstrap.cc:654] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:36.435216 14716 log.cc:824] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:36.435418 14715 tablet_bootstrap.cc:492] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658: No bootstrap required, opened a new log
I20260923 19:41:36.435698 14715 ts_tablet_manager.cc:1397] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260923 19:41:36.436321 14717 log.cc:824] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:36.438007 14716 tablet_bootstrap.cc:492] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a: No bootstrap required, opened a new log
I20260923 19:41:36.438256 14716 ts_tablet_manager.cc:1397] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:41:36.439157 14717 tablet_bootstrap.cc:492] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a: No bootstrap required, opened a new log
I20260923 19:41:36.439393 14717 ts_tablet_manager.cc:1397] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:41:36.445267 14716 raft_consensus.cc:348] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.445643 14716 raft_consensus.cc:374] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:36.445741 14716 raft_consensus.cc:729] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c33a67b6ce43969d8079ff9e4df26a, State: Initialized, Role: FOLLOWER
I20260923 19:41:36.445906 14715 raft_consensus.cc:348] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.446334 14715 raft_consensus.cc:374] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:36.446430 14715 raft_consensus.cc:729] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3725bfe6d264d40bb01e38032bb1658, State: Initialized, Role: FOLLOWER
I20260923 19:41:36.446394 14716 consensus_queue.cc:260] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.447095 14715 consensus_queue.cc:260] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.448222 14716 ts_tablet_manager.cc:1428] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260923 19:41:36.449167 14564 heartbeater.cc:503] Master 127.13.88.254:46845 was elected leader, sending a full tablet report...
I20260923 19:41:36.450969 14715 ts_tablet_manager.cc:1428] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260923 19:41:36.450882 14717 raft_consensus.cc:348] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.451366 14717 raft_consensus.cc:374] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:36.451489 14717 raft_consensus.cc:729] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04a0e9f20b384285b9f837969d61c04a, State: Initialized, Role: FOLLOWER
I20260923 19:41:36.452262 14717 consensus_queue.cc:260] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.453980 14697 heartbeater.cc:503] Master 127.13.88.254:46845 was elected leader, sending a full tablet report...
I20260923 19:41:36.454068 14717 ts_tablet_manager.cc:1428] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260923 19:41:36.523586 14722 raft_consensus.cc:482] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:36.523901 14722 raft_consensus.cc:504] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.525624 14722 leader_election.cc:288] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c33a67b6ce43969d8079ff9e4df26a (127.13.88.193:40681), 04a0e9f20b384285b9f837969d61c04a (127.13.88.195:34661)
I20260923 19:41:36.532143 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.525953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:34807 (local address 127.13.88.193:40681)
0923 19:41:36.526195 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.526203 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.526810 (+ 607us) server_negotiation.cc:407] Connection header received
0923 19:41:36.527144 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.527152 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.527238 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.527302 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:36.528006 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.528715 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.530452 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.531241 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.531430 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.531504 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.531758 (+ 254us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.531876 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:41:36.532316 14724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.525963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40681 (local address 127.13.88.194:34807)
0923 19:41:36.526720 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:36.526741 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:36.526921 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:36.527510 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:36.527514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:36.527546 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:36.527860 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.527869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.528847 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.528854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.530293 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.530304 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.531452 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.531458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.531608 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.531630 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:41:36.531733 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 19:41:36.531857 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":1,"thread_start_us":411,"threads_started":1}
I20260923 19:41:36.532706 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.527560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:50737 (local address 127.13.88.195:34661)
0923 19:41:36.527791 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.527799 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.527817 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:41:36.527886 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.527889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.527941 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.528035 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:36.528565 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.529279 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.530921 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.531754 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.531948 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.532030 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.532369 (+ 339us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.532505 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260923 19:41:36.533226 14725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.526840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:34661 (local address 127.13.88.194:50737)
0923 19:41:36.527545 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:36.527559 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:36.527707 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:36.528060 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:36.528064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:36.528086 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:36.528420 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.528428 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.529416 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.529421 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.530779 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:36.530789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.531988 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.531995 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:36.532169 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.532190 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 19:41:36.532870 (+ 680us) client_negotiation.cc:240] Negotiation successful
0923 19:41:36.532980 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":25,"thread_start_us":331,"threads_started":1}
I20260923 19:41:36.533180 14385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6ceded1c54703a8d901c748627702" candidate_uuid: "a3725bfe6d264d40bb01e38032bb1658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c33a67b6ce43969d8079ff9e4df26a" is_pre_election: true
I20260923 19:41:36.533735 14385 raft_consensus.cc:2454] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3725bfe6d264d40bb01e38032bb1658 in term 0.
I20260923 19:41:36.534282 14652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6ceded1c54703a8d901c748627702" candidate_uuid: "a3725bfe6d264d40bb01e38032bb1658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04a0e9f20b384285b9f837969d61c04a" is_pre_election: true
I20260923 19:41:36.534412 14454 leader_election.cc:302] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c33a67b6ce43969d8079ff9e4df26a, a3725bfe6d264d40bb01e38032bb1658; no voters:
I20260923 19:41:36.534765 14652 raft_consensus.cc:2454] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3725bfe6d264d40bb01e38032bb1658 in term 0.
I20260923 19:41:36.534819 14722 raft_consensus.cc:2781] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:36.534961 14722 raft_consensus.cc:482] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:36.535069 14722 raft_consensus.cc:3037] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:36.537267 14722 raft_consensus.cc:504] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.537860 14722 leader_election.cc:288] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [CANDIDATE]: Term 1 election: Requested vote from peers 83c33a67b6ce43969d8079ff9e4df26a (127.13.88.193:40681), 04a0e9f20b384285b9f837969d61c04a (127.13.88.195:34661)
I20260923 19:41:36.538287 14385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6ceded1c54703a8d901c748627702" candidate_uuid: "a3725bfe6d264d40bb01e38032bb1658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c33a67b6ce43969d8079ff9e4df26a"
I20260923 19:41:36.538362 14652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0bb6ceded1c54703a8d901c748627702" candidate_uuid: "a3725bfe6d264d40bb01e38032bb1658" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04a0e9f20b384285b9f837969d61c04a"
I20260923 19:41:36.538486 14385 raft_consensus.cc:3037] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:36.538601 14652 raft_consensus.cc:3037] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:36.540738 14385 raft_consensus.cc:2454] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3725bfe6d264d40bb01e38032bb1658 in term 1.
I20260923 19:41:36.540822 14652 raft_consensus.cc:2454] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3725bfe6d264d40bb01e38032bb1658 in term 1.
I20260923 19:41:36.541194 14454 leader_election.cc:302] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c33a67b6ce43969d8079ff9e4df26a, a3725bfe6d264d40bb01e38032bb1658; no voters:
I20260923 19:41:36.541512 14722 raft_consensus.cc:2781] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:36.541929 14722 raft_consensus.cc:686] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [term 1 LEADER]: Becoming Leader. State: Replica: a3725bfe6d264d40bb01e38032bb1658, State: Running, Role: LEADER
I20260923 19:41:36.542390 14722 consensus_queue.cc:237] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } }
I20260923 19:41:36.546679 14240 catalog_manager.cc:5495] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3725bfe6d264d40bb01e38032bb1658 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "a3725bfe6d264d40bb01e38032bb1658" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c33a67b6ce43969d8079ff9e4df26a" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3725bfe6d264d40bb01e38032bb1658" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 32983 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04a0e9f20b384285b9f837969d61c04a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34661 } health_report { overall_health: UNKNOWN } } }
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192494, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:36.568668 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.554879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33946 (local address 127.13.88.193:40681)
0923 19:41:36.555072 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.555078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.555597 (+ 519us) server_negotiation.cc:407] Connection header received
0923 19:41:36.555726 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.555730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.555791 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.555868 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.557247 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.557963 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.559310 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.559698 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.559805 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.563638 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.563649 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.563663 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.563695 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.566275 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.566890 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.566896 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.566898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.567016 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.567374 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.567377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.567379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.567714 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.567916 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.568157 (+ 241us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.568301 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260923 19:41:36.571532 14698 tablet.cc:2369] T 0bb6ceded1c54703a8d901c748627702 P 04a0e9f20b384285b9f837969d61c04a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260923 19:41:36.608070 14565 tablet.cc:2369] T 0bb6ceded1c54703a8d901c748627702 P a3725bfe6d264d40bb01e38032bb1658: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:36.621956 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.605560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33958 (local address 127.13.88.193:40681)
0923 19:41:36.605797 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.605806 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.605977 (+ 171us) server_negotiation.cc:407] Connection header received
0923 19:41:36.606140 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.606150 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.606253 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.606377 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.607701 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.609054 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.610285 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.611090 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.611254 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.615269 (+ 4015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.615278 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.615285 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.615335 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.619228 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.619799 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.619807 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.619812 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.619978 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.620335 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.620342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.620347 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.620739 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.621048 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.621179 (+ 131us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.621437 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260923 19:41:36.630617 14431 tablet.cc:2369] T 0bb6ceded1c54703a8d901c748627702 P 83c33a67b6ce43969d8079ff9e4df26a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:36.668671 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.651709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33972 (local address 127.13.88.193:40681)
0923 19:41:36.651962 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.651970 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.652117 (+ 147us) server_negotiation.cc:407] Connection header received
0923 19:41:36.652264 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.652273 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.652371 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.652499 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.653912 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.655248 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.656425 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.657271 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.657418 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.661573 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.661594 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.661602 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.661652 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.665754 (+ 4102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.666414 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.666421 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.666428 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.666617 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.666964 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.666971 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.666976 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.667454 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.667758 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.667904 (+ 146us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.668177 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260923 19:41:36.670414 14345 tablet_service.cc:2908] Rejecting scan request for tablet 0bb6ceded1c54703a8d901c748627702: Uninitialized: clean time has not yet been initialized
I20260923 19:41:36.673699 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14302
I20260923 19:41:36.691951 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.674739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33978 (local address 127.13.88.193:40681)
0923 19:41:36.674979 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.674988 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.677981 (+ 2993us) server_negotiation.cc:407] Connection header received
0923 19:41:36.678181 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.678189 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.678293 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.678407 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.679650 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.680962 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.682064 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.682908 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.683070 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.685195 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.685205 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.685212 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.685258 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.689001 (+ 3743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.689683 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.689690 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.689695 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.689851 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.690189 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.690197 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.690202 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.690660 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.690999 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.691188 (+ 189us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.691450 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:41:36.692790 14425 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:36.781531 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 14302
I20260923 19:41:36.798456 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14436
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:41:36.818257 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.799262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48058 (local address 127.13.88.194:32983)
0923 19:41:36.799528 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.799533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.799686 (+ 153us) server_negotiation.cc:407] Connection header received
0923 19:41:36.799878 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.799882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.799946 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.800143 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.801932 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.802644 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.804833 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.805227 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.805315 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.810381 (+ 5066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.810403 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.810445 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.810494 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.814946 (+ 4452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.815746 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.815759 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.815765 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.815942 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.816340 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.816348 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.816354 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.816858 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.817212 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.817467 (+ 255us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.817780 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260923 19:41:36.819314 14559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:36.919236 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 14436
I20260923 19:41:36.935990 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14569
Sep 23 19:41:36 dist-test-slave-xg7f krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:41:36.949448 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:36.936712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58808 (local address 127.13.88.195:34661)
0923 19:41:36.936873 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:36.936877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:36.936894 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:41:36.937069 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:36.937073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:36.937150 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:36.937233 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:36.938399 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.939185 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.940400 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:36.940763 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:36.940850 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:36.944641 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:36.944652 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:36.944669 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:36.944699 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:36.947436 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.947956 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.947963 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.947965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.948083 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:36.948376 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:36.948379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:36.948380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:36.948686 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:36.948881 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:36.949058 (+ 177us) server_negotiation.cc:299] Negotiation successful
0923 19:41:36.949208 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:41:36.950124 14692 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:37.036387 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 14569
I20260923 19:41:37.052795 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14209
I20260923 19:41:37.053910 14271 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:37.159561 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 14209
2026-09-23T19:41:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3998 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:37 dist-test-slave-xg7f krb5kdc[14745](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:37 dist-test-slave-xg7f krb5kdc[14745](info): set up 2 sockets
Sep 23 19:41:37 dist-test-slave-xg7f krb5kdc[14745](info): commencing operation
krb5kdc: starting...
W20260923 19:41:38.230978 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.001s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:38 dist-test-slave-xg7f krb5kdc[14745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:38.400849 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42251
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:42251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:38.708065 14758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:38.708331 14758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:38.708496 14758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:38.715523 14758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:38.715615 14758 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 19:41:38.715690 14758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:38.715806 14758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:38.715881 14758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:38.715998 14758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:38.725653 14758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:42251
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:38.726912 14758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:38.728248 14758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:38.741999 14763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:38.742023 14764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:38.741941 14766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:38.742790 14758 server_base.cc:1034] running on GCE node
I20260923 19:41:38.743597 14758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:38.744879 14758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:38.746110 14758 hybrid_clock.cc:648] HybridClock initialized: now 1790192498746031 us; error 65 us; skew 500 ppm
I20260923 19:41:38.746414 14758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:38 dist-test-slave-xg7f krb5kdc[14745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192498, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:38.749547 14758 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:41:38.750911 14758 webserver.cc:460] Webserver started at http://127.13.88.254:40685/ using document root <none> and password file <none>
I20260923 19:41:38.751658 14758 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:38.751786 14758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:38.752120 14758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:38.754940 14758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "dbe22989b6a6447e8395a7cde13b41ee"
format_stamp: "Formatted at 2026-09-23 19:41:38 on dist-test-slave-xg7f"
server_key: "0880bcaddb4dd85e4cd2780377e1e6e1"
server_key_iv: "9d220e8cee4402cbd8e537cd305bd4d5"
server_key_version: "encryptionkey@0"
I20260923 19:41:38.755752 14758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "dbe22989b6a6447e8395a7cde13b41ee"
format_stamp: "Formatted at 2026-09-23 19:41:38 on dist-test-slave-xg7f"
server_key: "0880bcaddb4dd85e4cd2780377e1e6e1"
server_key_iv: "9d220e8cee4402cbd8e537cd305bd4d5"
server_key_version: "encryptionkey@0"
I20260923 19:41:38.760629 14758 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:41:38.763944 14773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:38.765187 14758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:41:38.765343 14758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "dbe22989b6a6447e8395a7cde13b41ee"
format_stamp: "Formatted at 2026-09-23 19:41:38 on dist-test-slave-xg7f"
server_key: "0880bcaddb4dd85e4cd2780377e1e6e1"
server_key_iv: "9d220e8cee4402cbd8e537cd305bd4d5"
server_key_version: "encryptionkey@0"
I20260923 19:41:38.765540 14758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:38.785825 14758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:38.790000 14758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:38.790256 14758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:38.811218 14758 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:42251
I20260923 19:41:38.811225 14834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:42251 every 8 connection(s)
I20260923 19:41:38.812568 14758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:38.816220 14835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:38.816385 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 14758
I20260923 19:41:38.816612 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:41:38.817425 13667 external_mini_cluster.cc:1428] Setting key 22aa9687f167f27466f852295dcbcccb
I20260923 19:41:38.829833 14835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee: Bootstrap starting.
Sep 23 19:41:38 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:38.835017 14835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:38.836683 14835 log.cc:824] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:38.840862 14835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee: No bootstrap required, opened a new log
I20260923 19:41:38.845194 14838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:38.819490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58672 (local address 127.13.88.254:42251)
0923 19:41:38.820247 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:38.820258 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:38.820297 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:41:38.822399 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:38.822420 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:38.822807 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:38.823245 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:38.824778 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:38.826008 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:38.827708 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:38.828345 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:38.828466 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:38.834125 (+ 5659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:38.834136 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:38.834154 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:38.834217 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:38.838873 (+ 4656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:38.839791 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:38.839799 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:38.839807 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:38.840128 (+ 321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:38.840589 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:38.840593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:38.840596 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:38.841338 (+ 742us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:38.841654 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:38.843198 (+ 1544us) server_negotiation.cc:299] Negotiation successful
0923 19:41:38.843739 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":377,"threads_started":1}
I20260923 19:41:38.852676 14835 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbe22989b6a6447e8395a7cde13b41ee" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42251 } }
I20260923 19:41:38.853173 14835 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:38.853276 14835 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe22989b6a6447e8395a7cde13b41ee, State: Initialized, Role: FOLLOWER
I20260923 19:41:38.853935 14835 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbe22989b6a6447e8395a7cde13b41ee" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42251 } }
I20260923 19:41:38.854231 14835 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:38.854373 14835 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:38.854635 14835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:38.858119 14835 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbe22989b6a6447e8395a7cde13b41ee" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42251 } }
I20260923 19:41:38.858783 14835 leader_election.cc:302] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbe22989b6a6447e8395a7cde13b41ee; no voters:
I20260923 19:41:38.859467 14835 leader_election.cc:288] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:38.859611 14840 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:38.861631 14840 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [term 1 LEADER]: Becoming Leader. State: Replica: dbe22989b6a6447e8395a7cde13b41ee, State: Running, Role: LEADER
I20260923 19:41:38.861896 14835 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:38.862267 14840 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbe22989b6a6447e8395a7cde13b41ee" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42251 } }
I20260923 19:41:38.865600 14841 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbe22989b6a6447e8395a7cde13b41ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbe22989b6a6447e8395a7cde13b41ee" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42251 } } }
I20260923 19:41:38.865979 14841 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:38.865723 14842 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbe22989b6a6447e8395a7cde13b41ee. Latest consensus state: current_term: 1 leader_uuid: "dbe22989b6a6447e8395a7cde13b41ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbe22989b6a6447e8395a7cde13b41ee" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42251 } } }
I20260923 19:41:38.866104 14842 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:38.872538 14848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:38.875327 14857 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:41:38.878073 14848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:38.888041 14848 catalog_manager.cc:1347] Generated new cluster ID: 3021248386ff4966944f42a7c8fef398
I20260923 19:41:38.888151 14848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:38.906356 14848 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:38.908301 14848 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:38.916096 14848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee: Generated new TSK 0
I20260923 19:41:38.917133 14848 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:41:38.959800 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42251
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:39.272495 14861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:39.272789 14861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:39.272972 14861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:39.279927 14861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:39.280068 14861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:39.280222 14861 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:41:39.280361 14861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:41:39.289676 14861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:42251
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:39.290964 14861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:39.292377 14861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:39.305101 14869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:39.305254 14866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:39.305207 14867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:39.306278 14861 server_base.cc:1034] running on GCE node
I20260923 19:41:39.306917 14861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:39.307902 14861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:39.309154 14861 hybrid_clock.cc:648] HybridClock initialized: now 1790192499309093 us; error 53 us; skew 500 ppm
I20260923 19:41:39.309450 14861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:39 dist-test-slave-xg7f krb5kdc[14745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192499, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:39.312503 14861 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:41:39.313871 14861 webserver.cc:460] Webserver started at http://127.13.88.193:38469/ using document root <none> and password file <none>
I20260923 19:41:39.314560 14861 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:39.314669 14861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:39.314993 14861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:39.317780 14861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "d9df91a6f9bd43889cff09a4997891ed"
format_stamp: "Formatted at 2026-09-23 19:41:39 on dist-test-slave-xg7f"
server_key: "49e2871196ae370123b8c4cfd6dc2a98"
server_key_iv: "42336d92caa901d32a8c9c7a1c40c017"
server_key_version: "encryptionkey@0"
I20260923 19:41:39.318539 14861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "d9df91a6f9bd43889cff09a4997891ed"
format_stamp: "Formatted at 2026-09-23 19:41:39 on dist-test-slave-xg7f"
server_key: "49e2871196ae370123b8c4cfd6dc2a98"
server_key_iv: "42336d92caa901d32a8c9c7a1c40c017"
server_key_version: "encryptionkey@0"
I20260923 19:41:39.323545 14861 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260923 19:41:39.326752 14876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:39.328066 14861 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:41:39.328222 14861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "d9df91a6f9bd43889cff09a4997891ed"
format_stamp: "Formatted at 2026-09-23 19:41:39 on dist-test-slave-xg7f"
server_key: "49e2871196ae370123b8c4cfd6dc2a98"
server_key_iv: "42336d92caa901d32a8c9c7a1c40c017"
server_key_version: "encryptionkey@0"
I20260923 19:41:39.328436 14861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:39.342362 14861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:39.346024 14861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:39.346269 14861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:39.348883 14861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:39.349012 14861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:39.349145 14861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:39.349241 14861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:41:39 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192499, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:39.372676 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.349211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:33935 (local address 127.13.88.254:42251)
0923 19:41:39.349763 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:39.349769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:39.350869 (+ 1100us) server_negotiation.cc:407] Connection header received
0923 19:41:39.353850 (+ 2981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:39.353856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:39.353943 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:39.354057 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:39.356379 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.357657 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.359956 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.360561 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.360698 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.365637 (+ 4939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:39.365645 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:39.365652 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:39.365699 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:39.369180 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.369964 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.369969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.369973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.370108 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.370726 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.370729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.370731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.370981 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:39.371159 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:39.372220 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0923 19:41:39.372430 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":237,"threads_started":1}
I20260923 19:41:39.374521 14886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.349796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42251 (local address 127.13.88.193:33935)
0923 19:41:39.350687 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:39.350747 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:39.353519 (+ 2772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:39.354483 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:39.354499 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:39.355339 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:39.356156 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.356188 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.357861 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.357871 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.359810 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.359822 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.360829 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.360837 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.361041 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.361802 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:39.361844 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:39.365334 (+ 3490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:39.369329 (+ 3995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.369337 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.369352 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.369835 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.370248 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.370256 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.370263 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.370604 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.371141 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:39.371151 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:39.371693 (+ 542us) client_negotiation.cc:769] Sending connection context
0923 19:41:39.372084 (+ 391us) client_negotiation.cc:240] Negotiation successful
0923 19:41:39.372759 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":312,"threads_started":1}
I20260923 19:41:39.394907 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.381753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:54389 (local address 127.13.88.254:42251)
0923 19:41:39.381929 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:39.381934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:39.382591 (+ 657us) server_negotiation.cc:407] Connection header received
0923 19:41:39.382701 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:39.382709 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:39.382819 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:39.382938 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:39.384181 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.385207 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.386491 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.386907 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.387043 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.389183 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:39.389189 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:39.389209 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:39.389237 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:39.392386 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.393011 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.393018 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.393022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.393150 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.393501 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.393506 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.393510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.393764 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:39.393913 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:39.394362 (+ 449us) server_negotiation.cc:299] Negotiation successful
0923 19:41:39.394581 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:41:39.395026 14961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.381763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42251 (local address 127.13.88.193:54389)
0923 19:41:39.382483 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:39.382503 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:39.382609 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:39.382951 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:39.382954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:39.383478 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:39.384038 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.384049 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.385336 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.385343 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.386368 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.386379 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.387093 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.387132 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.387291 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.387934 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:39.387965 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:39.389015 (+ 1050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:39.392509 (+ 3494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.392519 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.392523 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.392892 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.393267 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.393272 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.393276 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.393396 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.393880 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:39.393884 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:39.394059 (+ 175us) client_negotiation.cc:769] Sending connection context
0923 19:41:39.394254 (+ 195us) client_negotiation.cc:240] Negotiation successful
0923 19:41:39.394588 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":375,"threads_started":1}
I20260923 19:41:39.400641 14861 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:44305
I20260923 19:41:39.400682 14996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:44305 every 8 connection(s)
I20260923 19:41:39.401744 14861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:41:39.403644 14997 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42251
I20260923 19:41:39.403863 14997 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:39.404476 14997 heartbeater.cc:511] Master 127.13.88.254:42251 requested a full tablet report, sending...
I20260923 19:41:39.406203 14790 ts_manager.cc:194] Registered new tserver with Master: d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305)
I20260923 19:41:39.406817 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 14861
I20260923 19:41:39.407021 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:41:39.407665 13667 external_mini_cluster.cc:1428] Setting key 63c8ad3bbc841d2b0992eee5fcf600b2
I20260923 19:41:39.407866 14790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:33935
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:41:39.443409 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42251
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:39.750138 15001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:39.750398 15001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:39.750530 15001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:39.757650 15001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:39.757750 15001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:39.757931 15001 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:41:39.758056 15001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:41:39.767740 15001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:42251
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:39.769186 15001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:39.770591 15001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:39.783171 15009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:39.783192 15006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:39.783224 15007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:39.784479 15001 server_base.cc:1034] running on GCE node
I20260923 19:41:39.785038 15001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:39.785873 15001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:39.787137 15001 hybrid_clock.cc:648] HybridClock initialized: now 1790192499787043 us; error 38 us; skew 500 ppm
I20260923 19:41:39.787437 15001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:39 dist-test-slave-xg7f krb5kdc[14745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192499, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:39.793115 15001 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:41:39.794464 15001 webserver.cc:460] Webserver started at http://127.13.88.194:33905/ using document root <none> and password file <none>
I20260923 19:41:39.795205 15001 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:39.795328 15001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:39.795641 15001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:39.798310 15001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "a3d7bff71fe1454c917dbed668cff3de"
format_stamp: "Formatted at 2026-09-23 19:41:39 on dist-test-slave-xg7f"
server_key: "41326e6b9cb64d57b7f9b69ce90da6cb"
server_key_iv: "6afead268f56ec08e1ce02ab02d217c0"
server_key_version: "encryptionkey@0"
I20260923 19:41:39.799058 15001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "a3d7bff71fe1454c917dbed668cff3de"
format_stamp: "Formatted at 2026-09-23 19:41:39 on dist-test-slave-xg7f"
server_key: "41326e6b9cb64d57b7f9b69ce90da6cb"
server_key_iv: "6afead268f56ec08e1ce02ab02d217c0"
server_key_version: "encryptionkey@0"
I20260923 19:41:39.803974 15001 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:41:39.807036 15016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:39.808442 15001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:41:39.808563 15001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "a3d7bff71fe1454c917dbed668cff3de"
format_stamp: "Formatted at 2026-09-23 19:41:39 on dist-test-slave-xg7f"
server_key: "41326e6b9cb64d57b7f9b69ce90da6cb"
server_key_iv: "6afead268f56ec08e1ce02ab02d217c0"
server_key_version: "encryptionkey@0"
I20260923 19:41:39.808736 15001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:39.835906 15001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:39.839635 15001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:39.839869 15001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:39.842291 15001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:39.842368 15001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:39.842526 15001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:39.842614 15001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:41:39 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192499, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:39.866541 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.843008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:54897 (local address 127.13.88.254:42251)
0923 19:41:39.843225 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:39.843231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:39.844643 (+ 1412us) server_negotiation.cc:407] Connection header received
0923 19:41:39.847671 (+ 3028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:39.847679 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:39.847768 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:39.847895 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:39.850125 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.851450 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.853718 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.854341 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.854482 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.859056 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:39.859061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:39.859070 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:39.859155 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:39.862820 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.863894 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.863898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.863900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.864009 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.864542 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.864548 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.864552 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.864990 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:39.865188 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:39.865978 (+ 790us) server_negotiation.cc:299] Negotiation successful
0923 19:41:39.866192 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260923 19:41:39.868130 15025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.843573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42251 (local address 127.13.88.194:54897)
0923 19:41:39.844468 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:39.844525 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:39.847305 (+ 2780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:39.848213 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:39.848227 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:39.849019 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:39.849887 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.849920 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.851656 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.851665 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.853566 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.853579 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.854596 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.854605 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.854945 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.855774 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:39.855812 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:39.858830 (+ 3018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:39.862971 (+ 4141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.862980 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.863005 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.863718 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.864128 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.864133 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.864136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.864404 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.865174 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:39.865185 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:39.865625 (+ 440us) client_negotiation.cc:769] Sending connection context
0923 19:41:39.865896 (+ 271us) client_negotiation.cc:240] Negotiation successful
0923 19:41:39.866454 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":355,"threads_started":1}
I20260923 19:41:39.890532 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.874751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:40185 (local address 127.13.88.254:42251)
0923 19:41:39.874964 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:39.874972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:39.876062 (+ 1090us) server_negotiation.cc:407] Connection header received
0923 19:41:39.876267 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:39.876271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:39.876325 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:39.876402 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:39.877877 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.878668 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.880815 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.881328 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.881473 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.884032 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:39.884036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:39.884039 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:39.884076 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:39.887543 (+ 3467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.888430 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.888436 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.888441 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.888615 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:39.889070 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:39.889077 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:39.889080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:39.889417 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:39.889530 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:39.889961 (+ 431us) server_negotiation.cc:299] Negotiation successful
0923 19:41:39.890146 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:41:39.890878 15109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:39.874793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42251 (local address 127.13.88.194:40185)
0923 19:41:39.875938 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:39.875969 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:39.876144 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:39.876465 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:39.876473 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:39.877213 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:39.877667 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.877683 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.878826 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.878834 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.880660 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:39.880678 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:39.881552 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:39.881561 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:39.881814 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:39.882476 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:39.882506 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:39.883853 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:39.887701 (+ 3848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.887705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.887708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.888305 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.888731 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:39.888737 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:39.888742 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:39.888941 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:39.889509 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:39.889520 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:39.889703 (+ 183us) client_negotiation.cc:769] Sending connection context
0923 19:41:39.889866 (+ 163us) client_negotiation.cc:240] Negotiation successful
0923 19:41:39.890271 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":402,"threads_started":1}
I20260923 19:41:39.895975 15001 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:42397
I20260923 19:41:39.896014 15135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:42397 every 8 connection(s)
I20260923 19:41:39.897198 15001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:41:39.899062 15136 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42251
I20260923 19:41:39.899308 15136 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:39.899313 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 15001
I20260923 19:41:39.899509 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:41:39.900089 13667 external_mini_cluster.cc:1428] Setting key 6b184441b69c677d9dd39cb6c3278ce1
I20260923 19:41:39.900099 15136 heartbeater.cc:511] Master 127.13.88.254:42251 requested a full tablet report, sending...
I20260923 19:41:39.901566 14789 ts_manager.cc:194] Registered new tserver with Master: a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397)
I20260923 19:41:39.902444 14789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:54897
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:41:39.937369 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42251
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:40.245164 15140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:40.245424 15140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:40.245517 15140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:40.252501 15140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:40.252606 15140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:40.252688 15140 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:41:40.252766 15140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:41:40.261775 15140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:42251
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:40.263001 15140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:40.264406 15140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:40.277668 15146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:40.277796 15145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:40.277797 15148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:40.284031 15140 server_base.cc:1034] running on GCE node
I20260923 19:41:40.284634 15140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:40.285507 15140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:40.286758 15140 hybrid_clock.cc:648] HybridClock initialized: now 1790192500286681 us; error 59 us; skew 500 ppm
I20260923 19:41:40.287057 15140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:40 dist-test-slave-xg7f krb5kdc[14745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192500, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:40.290197 15140 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:41:40.291803 15140 webserver.cc:460] Webserver started at http://127.13.88.195:43069/ using document root <none> and password file <none>
I20260923 19:41:40.292531 15140 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:40.292670 15140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:40.292999 15140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:40.295917 15140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445"
format_stamp: "Formatted at 2026-09-23 19:41:40 on dist-test-slave-xg7f"
server_key: "51d6c43ed679779f6b93a40ed33c2c66"
server_key_iv: "05ee93c5a68fd14da8fc146c4f23f6dd"
server_key_version: "encryptionkey@0"
I20260923 19:41:40.296710 15140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445"
format_stamp: "Formatted at 2026-09-23 19:41:40 on dist-test-slave-xg7f"
server_key: "51d6c43ed679779f6b93a40ed33c2c66"
server_key_iv: "05ee93c5a68fd14da8fc146c4f23f6dd"
server_key_version: "encryptionkey@0"
I20260923 19:41:40.302073 15140 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:41:40.305486 15155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:40.306780 15140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:40.306954 15140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445"
format_stamp: "Formatted at 2026-09-23 19:41:40 on dist-test-slave-xg7f"
server_key: "51d6c43ed679779f6b93a40ed33c2c66"
server_key_iv: "05ee93c5a68fd14da8fc146c4f23f6dd"
server_key_version: "encryptionkey@0"
I20260923 19:41:40.307209 15140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:40.332361 15140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:40.336571 15140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:40.336872 15140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:40.339537 15140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:40.339708 15140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:40.339831 15140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:40.339906 15140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:41:40 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192500, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:40.364882 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.340380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:54621 (local address 127.13.88.254:42251)
0923 19:41:40.340578 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.340585 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.342012 (+ 1427us) server_negotiation.cc:407] Connection header received
0923 19:41:40.344588 (+ 2576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.344597 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.344708 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.344838 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:40.346990 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.348086 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.351322 (+ 3236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.351817 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.351983 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.357379 (+ 5396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:40.357383 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:40.357392 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:40.357423 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:40.361282 (+ 3859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.362208 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.362212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.362215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.362339 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.362866 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.362874 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.362877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.363245 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:40.363397 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.364294 (+ 897us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.364521 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:41:40.366345 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.340966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42251 (local address 127.13.88.195:54621)
0923 19:41:40.341851 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.341895 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.344135 (+ 2240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.345135 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.345146 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.345929 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:40.346764 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.346807 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.348273 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.348281 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.351133 (+ 2852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.351153 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.352108 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.352120 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.352505 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.353361 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:40.353408 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:40.357162 (+ 3754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:40.361412 (+ 4250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:40.361418 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:40.361430 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:40.362039 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:40.362461 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:40.362469 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:40.362473 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:40.362747 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:40.363375 (+ 628us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:40.363382 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:40.363823 (+ 441us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.364191 (+ 368us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.364753 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":400,"threads_started":1}
I20260923 19:41:40.384308 15140 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:37529
I20260923 19:41:40.384331 15274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:37529 every 8 connection(s)
I20260923 19:41:40.385594 15140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:41:40.386952 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.372855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:59843 (local address 127.13.88.254:42251)
0923 19:41:40.373095 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.373103 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.373211 (+ 108us) server_negotiation.cc:407] Connection header received
0923 19:41:40.373371 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.373376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.373457 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.373557 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:40.374540 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.375881 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.377853 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.378751 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.378913 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.381493 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:40.381501 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:40.381508 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:40.381554 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:40.384282 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.385034 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.385041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.385044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.385170 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.385530 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.385536 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.385539 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.385834 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:40.385995 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.386386 (+ 391us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.386591 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260923 19:41:40.387089 15250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.372374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42251 (local address 127.13.88.195:59843)
0923 19:41:40.373090 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.373114 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.373249 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.373579 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.373582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.373988 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:40.374356 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.374373 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.376070 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.376077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.377712 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.377724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.378965 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.378970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.379073 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.379862 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:40.379896 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:40.381287 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:40.384419 (+ 3132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:40.384432 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:40.384436 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:40.384918 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:40.385286 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:40.385291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:40.385294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:40.385417 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:40.385946 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:40.385951 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:40.386139 (+ 188us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.386295 (+ 156us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.386622 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":715,"threads_started":1}
I20260923 19:41:40.387969 15275 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42251
I20260923 19:41:40.388404 15275 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:40.389138 15275 heartbeater.cc:511] Master 127.13.88.254:42251 requested a full tablet report, sending...
I20260923 19:41:40.390261 14789 ts_manager.cc:194] Registered new tserver with Master: a8cb2d9a47d04bf2a1a1e258e8db6445 (127.13.88.195:37529)
I20260923 19:41:40.391010 14789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:54621
I20260923 19:41:40.393522 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 15140
I20260923 19:41:40.393708 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:41:40.394117 13667 external_mini_cluster.cc:1428] Setting key 7bfcee14fc535db541b98e24f916064c
I20260923 19:41:40.396749 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:41:40.410599 14997 heartbeater.cc:503] Master 127.13.88.254:42251 was elected leader, sending a full tablet report...
Sep 23 19:41:40 dist-test-slave-xg7f krb5kdc[14745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192500, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:41:40 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192500, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:40.442554 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.429289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58674 (local address 127.13.88.254:42251)
0923 19:41:40.429507 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.429513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.429745 (+ 232us) server_negotiation.cc:407] Connection header received
0923 19:41:40.429971 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.429975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.430035 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.430140 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:40.431539 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.432292 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.433551 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.433967 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.434094 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.437691 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:40.437696 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:40.437699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:40.437728 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:40.440131 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.440703 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.440710 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.440714 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.440832 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.441186 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.441192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.441195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.441463 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:40.441706 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.441987 (+ 281us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.442193 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:41:40.446285 14789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:41:40.452801 14789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:40.474654 15291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.464192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33526 (local address 127.13.88.193:44305)
0923 19:41:40.465770 (+ 1578us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.465782 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.466427 (+ 645us) server_negotiation.cc:407] Connection header received
0923 19:41:40.466526 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.466534 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.466782 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.466974 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:40.467977 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.469621 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.472114 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.473529 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.473663 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.473880 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.474175 (+ 295us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.474371 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1420,"thread_start_us":1307,"threads_started":1}
I20260923 19:41:40.474742 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.463830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44305 (local address 127.0.0.1:33526)
0923 19:41:40.466181 (+ 2351us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.466197 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.466304 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.467240 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.467249 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.467283 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:40.467752 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.467771 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.469779 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.469787 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.471954 (+ 2167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.471970 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.473732 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.473739 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.473925 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.473979 (+ 54us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.474129 (+ 150us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.474328 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2239,"mutex_wait_us":1,"thread_start_us":2126,"threads_started":1}
I20260923 19:41:40.475411 15288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.463558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37529 (local address 127.0.0.1:41954)
0923 19:41:40.464425 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.464467 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.464639 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.468360 (+ 3721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.468364 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.468386 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:40.468816 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.468830 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.470800 (+ 1970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.470805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.472917 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.472930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.474665 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.474673 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.474879 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.474908 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.474972 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.475114 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":441,"threads_started":1}
I20260923 19:41:40.476024 15290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.463884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41954 (local address 127.13.88.195:37529)
0923 19:41:40.467767 (+ 3883us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.467775 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.467806 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:41:40.467896 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.467905 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.468157 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.468366 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:40.469023 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.470669 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.473081 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.474437 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.475225 (+ 788us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.475456 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.475537 (+ 81us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.475687 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3679,"thread_start_us":3446,"threads_started":1}
I20260923 19:41:40.476598 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.466164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33516 (local address 127.13.88.194:42397)
0923 19:41:40.467139 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.467147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.468114 (+ 967us) server_negotiation.cc:407] Connection header received
0923 19:41:40.468333 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.468342 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.468595 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.468796 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:40.470010 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.471322 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.473960 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.475338 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.475481 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.475651 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.476170 (+ 519us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.476342 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":693,"threads_started":1}
I20260923 19:41:40.477412 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.465607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:42397 (local address 127.0.0.1:33516)
0923 19:41:40.467983 (+ 2376us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.467996 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.468139 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.469272 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.469277 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.469300 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:40.469703 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.469715 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.471528 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.471535 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.473784 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.473798 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.475807 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.475813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.475981 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.476010 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.476096 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.477075 (+ 979us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2292,"thread_start_us":2118,"threads_started":1}
I20260923 19:41:40.478752 14927 tablet_service.cc:1467] Processing CreateTablet for tablet a51dae92a6db40f7ac580c6157c5d149 (DEFAULT_TABLE table=test-table [id=f01e29aab7024308a8a5f03911df2a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:40.479393 15205 tablet_service.cc:1467] Processing CreateTablet for tablet a51dae92a6db40f7ac580c6157c5d149 (DEFAULT_TABLE table=test-table [id=f01e29aab7024308a8a5f03911df2a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:40.480204 14927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a51dae92a6db40f7ac580c6157c5d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.480525 15205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a51dae92a6db40f7ac580c6157c5d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.480804 15066 tablet_service.cc:1467] Processing CreateTablet for tablet a51dae92a6db40f7ac580c6157c5d149 (DEFAULT_TABLE table=test-table [id=f01e29aab7024308a8a5f03911df2a4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:40.482041 15066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a51dae92a6db40f7ac580c6157c5d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.490706 15294 tablet_bootstrap.cc:492] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Bootstrap starting.
I20260923 19:41:40.494401 15294 tablet_bootstrap.cc:654] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.495589 15296 tablet_bootstrap.cc:492] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Bootstrap starting.
I20260923 19:41:40.495586 15294 log.cc:824] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:40.498836 15294 tablet_bootstrap.cc:492] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: No bootstrap required, opened a new log
I20260923 19:41:40.498884 15296 tablet_bootstrap.cc:654] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.499091 15294 ts_tablet_manager.cc:1397] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260923 19:41:40.499176 15295 tablet_bootstrap.cc:492] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Bootstrap starting.
I20260923 19:41:40.500066 15296 log.cc:824] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:40.501991 15295 tablet_bootstrap.cc:654] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.502826 15295 log.cc:824] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:40.505463 15296 tablet_bootstrap.cc:492] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: No bootstrap required, opened a new log
I20260923 19:41:40.505672 15295 tablet_bootstrap.cc:492] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: No bootstrap required, opened a new log
I20260923 19:41:40.505762 15296 ts_tablet_manager.cc:1397] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260923 19:41:40.505915 15295 ts_tablet_manager.cc:1397] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260923 19:41:40.510852 15294 raft_consensus.cc:348] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.511354 15294 raft_consensus.cc:374] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.511534 15294 raft_consensus.cc:729] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8cb2d9a47d04bf2a1a1e258e8db6445, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.512162 15294 consensus_queue.cc:260] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.513523 15275 heartbeater.cc:503] Master 127.13.88.254:42251 was elected leader, sending a full tablet report...
I20260923 19:41:40.513826 15296 raft_consensus.cc:348] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.514151 15296 raft_consensus.cc:374] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.514267 15296 raft_consensus.cc:729] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d7bff71fe1454c917dbed668cff3de, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.514860 15296 consensus_queue.cc:260] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.515866 15136 heartbeater.cc:503] Master 127.13.88.254:42251 was elected leader, sending a full tablet report...
I20260923 19:41:40.516004 15295 raft_consensus.cc:348] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.516422 15295 raft_consensus.cc:374] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.516523 15295 raft_consensus.cc:729] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9df91a6f9bd43889cff09a4997891ed, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.517100 15295 consensus_queue.cc:260] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.517854 15296 ts_tablet_manager.cc:1428] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260923 19:41:40.518800 15294 ts_tablet_manager.cc:1428] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Time spent starting tablet: real 0.020s user 0.013s sys 0.001s
I20260923 19:41:40.520251 15295 ts_tablet_manager.cc:1428] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
W20260923 19:41:40.638691 15276 tablet.cc:2369] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:41:40.649206 15137 tablet.cc:2369] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:41:40.654116 14998 tablet.cc:2369] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:41:40.669629 15300 raft_consensus.cc:482] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:40.669993 15300 raft_consensus.cc:504] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.671831 15300 leader_election.cc:288] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305), a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397)
I20260923 19:41:40.678534 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.672096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44305 (local address 127.13.88.195:36579)
0923 19:41:40.672449 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.672472 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.672603 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.672991 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.672996 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.673032 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:40.673265 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.673277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.674519 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.674522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.676570 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.676584 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.677948 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.677952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.678076 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.678099 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.678168 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.678251 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":54}
I20260923 19:41:40.678638 15291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.672284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:36579 (local address 127.13.88.193:44305)
0923 19:41:40.672497 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.672505 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.672529 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:41:40.672801 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.672807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.672882 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.672968 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:40.673406 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.674388 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.676708 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.677826 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.677975 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.678047 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.678219 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.678339 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:41:40.679316 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.672819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:44599 (local address 127.13.88.194:42397)
0923 19:41:40.673021 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.673027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.673121 (+ 94us) server_negotiation.cc:407] Connection header received
0923 19:41:40.673274 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.673278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.673355 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.673444 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:40.673870 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.674788 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.677099 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.678309 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.678474 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.678540 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.678908 (+ 368us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.679024 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:41:40.679386 15303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.672335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:42397 (local address 127.13.88.195:44599)
0923 19:41:40.673021 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.673036 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.673149 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.673471 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.673473 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.673493 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:40.673737 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.673744 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.674923 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.674932 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.676962 (+ 2030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.676973 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.678543 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.678552 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.678741 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.678772 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.678884 (+ 112us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.679001 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":30,"thread_start_us":396,"threads_started":1}
I20260923 19:41:40.679615 14949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a51dae92a6db40f7ac580c6157c5d149" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9df91a6f9bd43889cff09a4997891ed" is_pre_election: true
I20260923 19:41:40.680121 14949 raft_consensus.cc:2454] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 0.
I20260923 19:41:40.680722 15157 leader_election.cc:302] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8cb2d9a47d04bf2a1a1e258e8db6445, d9df91a6f9bd43889cff09a4997891ed; no voters:
I20260923 19:41:40.681095 15300 raft_consensus.cc:2781] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:40.681252 15300 raft_consensus.cc:482] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:40.681361 15300 raft_consensus.cc:3037] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:40.681258 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a51dae92a6db40f7ac580c6157c5d149" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d7bff71fe1454c917dbed668cff3de" is_pre_election: true
I20260923 19:41:40.681771 15086 raft_consensus.cc:2454] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 0.
I20260923 19:41:40.683759 15300 raft_consensus.cc:504] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.684238 15300 leader_election.cc:288] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 election: Requested vote from peers d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305), a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397)
I20260923 19:41:40.684659 14949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a51dae92a6db40f7ac580c6157c5d149" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9df91a6f9bd43889cff09a4997891ed"
I20260923 19:41:40.684702 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a51dae92a6db40f7ac580c6157c5d149" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d7bff71fe1454c917dbed668cff3de"
I20260923 19:41:40.684846 14949 raft_consensus.cc:3037] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:40.684893 15086 raft_consensus.cc:3037] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:40.686889 14949 raft_consensus.cc:2454] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 1.
I20260923 19:41:40.686993 15086 raft_consensus.cc:2454] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 1.
I20260923 19:41:40.687278 15157 leader_election.cc:302] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8cb2d9a47d04bf2a1a1e258e8db6445, d9df91a6f9bd43889cff09a4997891ed; no voters:
I20260923 19:41:40.687543 15300 raft_consensus.cc:2781] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:40.687961 15300 raft_consensus.cc:686] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 LEADER]: Becoming Leader. State: Replica: a8cb2d9a47d04bf2a1a1e258e8db6445, State: Running, Role: LEADER
I20260923 19:41:40.688485 15300 consensus_queue.cc:237] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } }
I20260923 19:41:40.692710 14790 catalog_manager.cc:5495] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8cb2d9a47d04bf2a1a1e258e8db6445 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } health_report { overall_health: UNKNOWN } } }
I20260923 19:41:40.721891 15290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.716936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41962 (local address 127.13.88.195:37529)
0923 19:41:40.717167 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.717174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.717269 (+ 95us) server_negotiation.cc:407] Connection header received
0923 19:41:40.717512 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.717516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.717587 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.717700 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:40.717996 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.718683 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.719982 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.720371 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.720461 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.720859 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:40.721333 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:40.721438 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.721535 (+ 97us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.721593 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260923 19:41:40.729528 15086 raft_consensus.cc:1261] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Refusing update from remote peer a8cb2d9a47d04bf2a1a1e258e8db6445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:40.729524 14949 raft_consensus.cc:1261] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Refusing update from remote peer a8cb2d9a47d04bf2a1a1e258e8db6445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:40.730429 15304 consensus_queue.cc:1035] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:40.730775 15300 consensus_queue.cc:1035] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:40.741209 15307 mvcc.cc:205] Tried to move back new op lower bound from 7332628482978373632 to 7332628482823614464. Current Snapshot: MvccSnapshot[applied={T|T < 7332628482978373632}]
I20260923 19:41:40.741895 15309 mvcc.cc:205] Tried to move back new op lower bound from 7332628482978373632 to 7332628482823614464. Current Snapshot: MvccSnapshot[applied={T|T < 7332628482978373632}]
I20260923 19:41:40.759735 14789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:40.760036 14789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:40.763518 14789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee: Sending DeleteTablet for 3 replicas of tablet a51dae92a6db40f7ac580c6157c5d149
I20260923 19:41:40.764540 15205 tablet_service.cc:1514] Processing DeleteTablet for tablet a51dae92a6db40f7ac580c6157c5d149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:40 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41954
I20260923 19:41:40.764653 14927 tablet_service.cc:1514] Processing DeleteTablet for tablet a51dae92a6db40f7ac580c6157c5d149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:40 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:33526
I20260923 19:41:40.764901 15066 tablet_service.cc:1514] Processing DeleteTablet for tablet a51dae92a6db40f7ac580c6157c5d149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:40 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:33516
I20260923 19:41:40.766216 14789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:41:40.767273 14789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:40.777259 15317 tablet_replica.cc:330] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: stopping tablet replica
I20260923 19:41:40.777628 15065 tablet_service.cc:1467] Processing CreateTablet for tablet d797e53a027f476a85bcda79a5ee6ea4 (DEFAULT_TABLE table=test-table [id=c92a7106c0964186844dc91579da6d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:40.777868 15204 tablet_service.cc:1467] Processing CreateTablet for tablet d797e53a027f476a85bcda79a5ee6ea4 (DEFAULT_TABLE table=test-table [id=c92a7106c0964186844dc91579da6d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:40.778275 15065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d797e53a027f476a85bcda79a5ee6ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.778434 15204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d797e53a027f476a85bcda79a5ee6ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.780817 15318 tablet_replica.cc:330] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: stopping tablet replica
I20260923 19:41:40.781152 15318 raft_consensus.cc:2229] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:40.781544 15318 raft_consensus.cc:2258] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:40.778411 14926 tablet_service.cc:1467] Processing CreateTablet for tablet d797e53a027f476a85bcda79a5ee6ea4 (DEFAULT_TABLE table=test-table [id=c92a7106c0964186844dc91579da6d58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:40.782253 14926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d797e53a027f476a85bcda79a5ee6ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.783823 15318 ts_tablet_manager.cc:1905] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:40.785422 15294 tablet_bootstrap.cc:492] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: Bootstrap starting.
I20260923 19:41:40.789435 15295 tablet_bootstrap.cc:492] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: Bootstrap starting.
I20260923 19:41:40.790154 15318 ts_tablet_manager.cc:1918] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:41:40.790311 15318 log.cc:1196] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/a51dae92a6db40f7ac580c6157c5d149
I20260923 19:41:40.790815 15318 ts_tablet_manager.cc:1939] T a51dae92a6db40f7ac580c6157c5d149 P a3d7bff71fe1454c917dbed668cff3de: Deleting consensus metadata
I20260923 19:41:40.791157 15295 tablet_bootstrap.cc:654] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.793340 14777 catalog_manager.cc:4841] TS a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397): tablet a51dae92a6db40f7ac580c6157c5d149 (table test-table [id=f01e29aab7024308a8a5f03911df2a4d]) successfully deleted
I20260923 19:41:40.793447 15294 tablet_bootstrap.cc:654] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.794627 15296 tablet_bootstrap.cc:492] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: Bootstrap starting.
I20260923 19:41:40.796901 15296 tablet_bootstrap.cc:654] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.796943 15317 raft_consensus.cc:2229] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:40.797417 15317 raft_consensus.cc:2258] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:40.803864 15294 tablet_bootstrap.cc:492] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: No bootstrap required, opened a new log
I20260923 19:41:40.804137 15294 ts_tablet_manager.cc:1397] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.008s
I20260923 19:41:40.804839 15317 ts_tablet_manager.cc:1905] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:40.805073 15294 raft_consensus.cc:348] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.805406 15294 raft_consensus.cc:374] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.805558 15294 raft_consensus.cc:729] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8cb2d9a47d04bf2a1a1e258e8db6445, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.805884 15294 consensus_queue.cc:260] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.807816 15316 tablet_replica.cc:330] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: stopping tablet replica
I20260923 19:41:40.809976 15316 raft_consensus.cc:2229] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:41:40.809190 15294 ts_tablet_manager.cc:1428] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:41:40.810727 15316 raft_consensus.cc:2258] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:40.813532 15296 tablet_bootstrap.cc:492] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: No bootstrap required, opened a new log
I20260923 19:41:40.813625 15295 tablet_bootstrap.cc:492] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: No bootstrap required, opened a new log
I20260923 19:41:40.813817 15295 ts_tablet_manager.cc:1397] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.006s
I20260923 19:41:40.816226 15295 raft_consensus.cc:348] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.816499 15295 raft_consensus.cc:374] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.816598 15296 ts_tablet_manager.cc:1397] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.008s
I20260923 19:41:40.816670 15295 raft_consensus.cc:729] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9df91a6f9bd43889cff09a4997891ed, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.816496 15317 ts_tablet_manager.cc:1918] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:41:40.817137 15317 log.cc:1196] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/a51dae92a6db40f7ac580c6157c5d149
I20260923 19:41:40.817544 15296 raft_consensus.cc:348] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.817723 15317 ts_tablet_manager.cc:1939] T a51dae92a6db40f7ac580c6157c5d149 P d9df91a6f9bd43889cff09a4997891ed: Deleting consensus metadata
I20260923 19:41:40.817847 15296 raft_consensus.cc:374] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.817991 15296 raft_consensus.cc:729] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d7bff71fe1454c917dbed668cff3de, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.818347 15296 consensus_queue.cc:260] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.817009 15295 consensus_queue.cc:260] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.819418 14775 catalog_manager.cc:4841] TS d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305): tablet a51dae92a6db40f7ac580c6157c5d149 (table test-table [id=f01e29aab7024308a8a5f03911df2a4d]) successfully deleted
I20260923 19:41:40.819640 15295 ts_tablet_manager.cc:1428] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260923 19:41:40.819996 15316 ts_tablet_manager.cc:1905] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:40.823884 15296 ts_tablet_manager.cc:1428] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260923 19:41:40.827251 15316 ts_tablet_manager.cc:1918] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:41:40.827409 15316 log.cc:1196] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/a51dae92a6db40f7ac580c6157c5d149
I20260923 19:41:40.827951 15316 ts_tablet_manager.cc:1939] T a51dae92a6db40f7ac580c6157c5d149 P a8cb2d9a47d04bf2a1a1e258e8db6445: Deleting consensus metadata
I20260923 19:41:40.829674 14777 catalog_manager.cc:4841] TS a8cb2d9a47d04bf2a1a1e258e8db6445 (127.13.88.195:37529): tablet a51dae92a6db40f7ac580c6157c5d149 (table test-table [id=f01e29aab7024308a8a5f03911df2a4d]) successfully deleted
I20260923 19:41:40.884562 15304 raft_consensus.cc:482] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:40.884799 15304 raft_consensus.cc:504] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.885576 15304 leader_election.cc:288] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305), a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397)
I20260923 19:41:40.886142 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d797e53a027f476a85bcda79a5ee6ea4" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d7bff71fe1454c917dbed668cff3de" is_pre_election: true
I20260923 19:41:40.886166 14949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d797e53a027f476a85bcda79a5ee6ea4" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9df91a6f9bd43889cff09a4997891ed" is_pre_election: true
I20260923 19:41:40.886394 15086 raft_consensus.cc:2454] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 0.
I20260923 19:41:40.886413 14949 raft_consensus.cc:2454] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 0.
I20260923 19:41:40.886883 15159 leader_election.cc:302] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3d7bff71fe1454c917dbed668cff3de, a8cb2d9a47d04bf2a1a1e258e8db6445; no voters:
I20260923 19:41:40.887261 15304 raft_consensus.cc:2781] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:40.887378 15304 raft_consensus.cc:482] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:40.887532 15304 raft_consensus.cc:3037] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:40.889730 15304 raft_consensus.cc:504] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.890328 15304 leader_election.cc:288] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 election: Requested vote from peers d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305), a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397)
I20260923 19:41:40.890691 14949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d797e53a027f476a85bcda79a5ee6ea4" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9df91a6f9bd43889cff09a4997891ed"
I20260923 19:41:40.890810 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d797e53a027f476a85bcda79a5ee6ea4" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d7bff71fe1454c917dbed668cff3de"
I20260923 19:41:40.890880 14949 raft_consensus.cc:3037] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:40.891021 15086 raft_consensus.cc:3037] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:40.893906 14949 raft_consensus.cc:2454] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 1.
I20260923 19:41:40.893997 15086 raft_consensus.cc:2454] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 1.
I20260923 19:41:40.894510 15157 leader_election.cc:302] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8cb2d9a47d04bf2a1a1e258e8db6445, d9df91a6f9bd43889cff09a4997891ed; no voters:
I20260923 19:41:40.894997 15304 raft_consensus.cc:2781] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:40.895206 15304 raft_consensus.cc:686] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 LEADER]: Becoming Leader. State: Replica: a8cb2d9a47d04bf2a1a1e258e8db6445, State: Running, Role: LEADER
I20260923 19:41:40.895851 15304 consensus_queue.cc:237] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.898432 14790 catalog_manager.cc:5495] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8cb2d9a47d04bf2a1a1e258e8db6445 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } health_report { overall_health: HEALTHY } } }
Sep 23 19:41:40 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192498, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:40.955760 15328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.941511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42251 (local address 127.0.0.1:58688)
0923 19:41:40.942145 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:40.942163 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:40.942285 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:40.942635 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:40.942638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:40.943359 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:40.943646 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.943655 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.945041 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.945044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.945931 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:40.945941 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.946922 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.946926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:40.947035 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.947766 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:40.947786 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:40.950018 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:40.953449 (+ 3431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:40.953458 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:40.953464 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:40.953875 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:40.954242 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:40.954245 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:40.954248 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:40.954368 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:40.954925 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:40.954931 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:40.955068 (+ 137us) client_negotiation.cc:769] Sending connection context
0923 19:41:40.955248 (+ 180us) client_negotiation.cc:240] Negotiation successful
0923 19:41:40.955420 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":348,"threads_started":1}
I20260923 19:41:40.956017 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:40.941501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58688 (local address 127.13.88.254:42251)
0923 19:41:40.941695 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:40.941701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:40.942263 (+ 562us) server_negotiation.cc:407] Connection header received
0923 19:41:40.942391 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:40.942396 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:40.942491 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:40.942598 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:40.943795 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.944919 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.946082 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:40.946757 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:40.946876 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:40.950193 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:40.950200 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:40.950205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:40.950257 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:40.953325 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.953975 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.953980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.953983 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.954136 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:40.954465 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:40.954471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:40.954474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:40.954815 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:40.954947 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:40.955367 (+ 420us) server_negotiation.cc:299] Negotiation successful
0923 19:41:40.955612 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:41:40.960983 14790 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:58688:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 19:41:40.962209 14790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:40.969504 15065 tablet_service.cc:1467] Processing CreateTablet for tablet b8631225f1a14e4682e5d54102456cc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c59ff8eb9195435fa4fda2d5ac5ab5e4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:41:40.969491 15205 tablet_service.cc:1467] Processing CreateTablet for tablet b8631225f1a14e4682e5d54102456cc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c59ff8eb9195435fa4fda2d5ac5ab5e4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:41:40.970031 15065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8631225f1a14e4682e5d54102456cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.970093 15205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8631225f1a14e4682e5d54102456cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.970084 14926 tablet_service.cc:1467] Processing CreateTablet for tablet b8631225f1a14e4682e5d54102456cc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c59ff8eb9195435fa4fda2d5ac5ab5e4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:41:40.970597 14926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8631225f1a14e4682e5d54102456cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:40.977692 15296 tablet_bootstrap.cc:492] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: Bootstrap starting.
I20260923 19:41:40.977895 15294 tablet_bootstrap.cc:492] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: Bootstrap starting.
I20260923 19:41:40.978144 15295 tablet_bootstrap.cc:492] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: Bootstrap starting.
I20260923 19:41:40.979427 15296 tablet_bootstrap.cc:654] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.979573 15294 tablet_bootstrap.cc:654] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.979743 15295 tablet_bootstrap.cc:654] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:40.989874 15296 tablet_bootstrap.cc:492] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: No bootstrap required, opened a new log
I20260923 19:41:40.990170 15296 ts_tablet_manager.cc:1397] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260923 19:41:40.991083 15296 raft_consensus.cc:348] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.991418 15296 raft_consensus.cc:374] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.991535 15296 raft_consensus.cc:729] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d7bff71fe1454c917dbed668cff3de, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.991925 15296 consensus_queue.cc:260] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.992475 15301 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:40.992842 15294 tablet_bootstrap.cc:492] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: No bootstrap required, opened a new log
I20260923 19:41:40.992842 15301 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:40.992844 15295 tablet_bootstrap.cc:492] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: No bootstrap required, opened a new log
I20260923 19:41:40.992983 15295 ts_tablet_manager.cc:1397] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260923 19:41:40.993000 15294 ts_tablet_manager.cc:1397] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.007s
I20260923 19:41:40.993630 15295 raft_consensus.cc:348] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.993841 15295 raft_consensus.cc:374] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.993768 15294 raft_consensus.cc:348] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.993965 15295 raft_consensus.cc:729] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9df91a6f9bd43889cff09a4997891ed, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.994007 15294 raft_consensus.cc:374] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:40.994102 15294 raft_consensus.cc:729] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8cb2d9a47d04bf2a1a1e258e8db6445, State: Initialized, Role: FOLLOWER
I20260923 19:41:40.994258 15295 consensus_queue.cc:260] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.994413 15294 consensus_queue.cc:260] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:40.994699 15302 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:40.995018 15302 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:40.995011 15294 ts_tablet_manager.cc:1428] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:41:40.995896 15296 ts_tablet_manager.cc:1428] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260923 19:41:40.995858 15304 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:40.996109 15304 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:40.997278 15295 ts_tablet_manager.cc:1428] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:41:41.015870 15304 raft_consensus.cc:482] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:41.016044 15304 raft_consensus.cc:504] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:41.016685 15304 leader_election.cc:288] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305), a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397)
I20260923 19:41:41.017145 14949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8631225f1a14e4682e5d54102456cc0" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9df91a6f9bd43889cff09a4997891ed" is_pre_election: true
I20260923 19:41:41.017210 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8631225f1a14e4682e5d54102456cc0" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d7bff71fe1454c917dbed668cff3de" is_pre_election: true
I20260923 19:41:41.017398 14949 raft_consensus.cc:2454] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 0.
I20260923 19:41:41.017468 15086 raft_consensus.cc:2454] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 0.
I20260923 19:41:41.017840 15157 leader_election.cc:302] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8cb2d9a47d04bf2a1a1e258e8db6445, d9df91a6f9bd43889cff09a4997891ed; no voters:
I20260923 19:41:41.018137 15304 raft_consensus.cc:2781] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:41.018266 15304 raft_consensus.cc:482] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:41.018348 15304 raft_consensus.cc:3037] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:41.020576 15304 raft_consensus.cc:504] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:41.021054 15304 leader_election.cc:288] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 election: Requested vote from peers d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305), a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397)
I20260923 19:41:41.021469 14949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8631225f1a14e4682e5d54102456cc0" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9df91a6f9bd43889cff09a4997891ed"
I20260923 19:41:41.021555 15086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8631225f1a14e4682e5d54102456cc0" candidate_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3d7bff71fe1454c917dbed668cff3de"
I20260923 19:41:41.021677 14949 raft_consensus.cc:3037] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:41.021773 15086 raft_consensus.cc:3037] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:41.023725 14949 raft_consensus.cc:2454] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 1.
I20260923 19:41:41.024144 15157 leader_election.cc:302] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8cb2d9a47d04bf2a1a1e258e8db6445, d9df91a6f9bd43889cff09a4997891ed; no voters:
I20260923 19:41:41.024441 15304 raft_consensus.cc:2781] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:41.024631 15304 raft_consensus.cc:686] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 LEADER]: Becoming Leader. State: Replica: a8cb2d9a47d04bf2a1a1e258e8db6445, State: Running, Role: LEADER
I20260923 19:41:41.024685 15086 raft_consensus.cc:2454] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8cb2d9a47d04bf2a1a1e258e8db6445 in term 1.
I20260923 19:41:41.024932 15304 consensus_queue.cc:237] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } }
I20260923 19:41:41.026820 15300 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: TxnStatusTablet state changed. Reason: New leader a8cb2d9a47d04bf2a1a1e258e8db6445. Latest consensus state: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:41.027122 15300 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:41:41.028167 14790 catalog_manager.cc:5495] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8cb2d9a47d04bf2a1a1e258e8db6445 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } health_report { overall_health: HEALTHY } } }
I20260923 19:41:41.035568 15333 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 19:41:41.035791 15333 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 19:41:41.053947 15328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.048625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37529 (local address 127.0.0.1:41970)
0923 19:41:41.048834 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:41.048850 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:41.048948 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:41.049351 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:41.049354 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:41.049362 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:41:41.049514 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:41.049521 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.050949 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.050952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:41.051983 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:41.051995 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.052944 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.052948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:41.053108 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.053164 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:41:41.053570 (+ 406us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:41:41.053582 (+ 12us) client_negotiation.cc:769] Sending connection context
0923 19:41:41.053639 (+ 57us) client_negotiation.cc:240] Negotiation successful
0923 19:41:41.053742 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260923 19:41:41.054077 15290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.048671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41970 (local address 127.13.88.195:37529)
0923 19:41:41.048855 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:41.048862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:41.048886 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:41:41.049121 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:41.049127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:41.049231 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:41.049333 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:41.049639 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.050833 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.052123 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.052810 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.052947 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.053332 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:41.053477 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:41.053571 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:41.053700 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 19:41:41.053782 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:41:41.057333 15086 raft_consensus.cc:1261] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Refusing update from remote peer a8cb2d9a47d04bf2a1a1e258e8db6445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:41.057367 14949 raft_consensus.cc:1261] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Refusing update from remote peer a8cb2d9a47d04bf2a1a1e258e8db6445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:41.057926 15300 consensus_queue.cc:1035] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:41.058192 15304 consensus_queue.cc:1035] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:41.061887 15302 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: TxnStatusTablet state changed. Reason: New leader a8cb2d9a47d04bf2a1a1e258e8db6445. Latest consensus state: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:41.062147 15302 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:41.064841 15308 mvcc.cc:205] Tried to move back new op lower bound from 7332628484324970496 to 7332628484200955904. Current Snapshot: MvccSnapshot[applied={T|T < 7332628484324970496}]
I20260923 19:41:41.065510 15302 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:41.065723 15302 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P d9df91a6f9bd43889cff09a4997891ed: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:41.072575 15300 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:41.073280 15300 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:41:41.075584 15301 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: TxnStatusTablet state changed. Reason: New leader a8cb2d9a47d04bf2a1a1e258e8db6445. Latest consensus state: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:41.075852 15301 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:41.081673 15301 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:41.081874 15301 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P a3d7bff71fe1454c917dbed668cff3de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:41.084460 15300 tablet_replica.cc:439] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 } } peers { permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 } } peers { permanent_uuid: "a8cb2d9a47d04bf2a1a1e258e8db6445" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37529 } } }
I20260923 19:41:41.084741 15300 tablet_replica.cc:442] T b8631225f1a14e4682e5d54102456cc0 P a8cb2d9a47d04bf2a1a1e258e8db6445: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:41:41.092921 15341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.086835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37529 (local address 127.13.88.195:57773)
0923 19:41:41.087482 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:41.087500 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:41.087610 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:41.087909 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:41.087912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:41.087920 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:41:41.088199 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:41.088206 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.089639 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.089642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:41.090800 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:41.090810 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.091801 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.091806 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:41.091951 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.092000 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:41:41.092423 (+ 423us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:41:41.092431 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 19:41:41.092489 (+ 58us) client_negotiation.cc:240] Negotiation successful
0923 19:41:41.092616 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":19,"thread_start_us":402,"threads_started":1}
I20260923 19:41:41.092918 15290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.086682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:57773 (local address 127.13.88.195:37529)
0923 19:41:41.086842 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:41.086846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:41.087581 (+ 735us) server_negotiation.cc:407] Connection header received
0923 19:41:41.087705 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:41.087710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:41.087789 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:41.087888 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:41.088339 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.089499 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.090948 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.091628 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.091765 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.092175 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:41.092326 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:41.092432 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:41.092510 (+ 78us) server_negotiation.cc:299] Negotiation successful
0923 19:41:41.092625 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":48}
I20260923 19:41:41.101313 15086 raft_consensus.cc:1261] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Refusing update from remote peer a8cb2d9a47d04bf2a1a1e258e8db6445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:41.101382 14949 raft_consensus.cc:1261] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Refusing update from remote peer a8cb2d9a47d04bf2a1a1e258e8db6445: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:41.101794 15304 consensus_queue.cc:1035] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3d7bff71fe1454c917dbed668cff3de" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:41.101998 15300 consensus_queue.cc:1035] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9df91a6f9bd43889cff09a4997891ed" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:41.159423 14788 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:41.159721 14788 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:41.162858 14788 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dbe22989b6a6447e8395a7cde13b41ee: Sending DeleteTablet for 3 replicas of tablet d797e53a027f476a85bcda79a5ee6ea4
I20260923 19:41:41.163759 15065 tablet_service.cc:1514] Processing DeleteTablet for tablet d797e53a027f476a85bcda79a5ee6ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:41 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:33516
I20260923 19:41:41.164045 15318 tablet_replica.cc:330] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: stopping tablet replica
I20260923 19:41:41.164252 15318 raft_consensus.cc:2229] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:41.164438 15318 raft_consensus.cc:2258] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:41.164875 15204 tablet_service.cc:1514] Processing DeleteTablet for tablet d797e53a027f476a85bcda79a5ee6ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:41 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41954
I20260923 19:41:41.165019 14926 tablet_service.cc:1514] Processing DeleteTablet for tablet d797e53a027f476a85bcda79a5ee6ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:41 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:33526
I20260923 19:41:41.165174 15316 tablet_replica.cc:330] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: stopping tablet replica
I20260923 19:41:41.165359 15316 raft_consensus.cc:2229] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:41:41.165643 15316 raft_consensus.cc:2258] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:41.165952 15317 tablet_replica.cc:330] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: stopping tablet replica
I20260923 19:41:41.166172 15317 raft_consensus.cc:2229] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:41.166376 15317 raft_consensus.cc:2258] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:41.167021 15316 ts_tablet_manager.cc:1905] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:41.167594 15317 ts_tablet_manager.cc:1905] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:41.169572 15318 ts_tablet_manager.cc:1905] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:41.174422 15317 ts_tablet_manager.cc:1918] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:41.174547 15317 log.cc:1196] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/d797e53a027f476a85bcda79a5ee6ea4
I20260923 19:41:41.174935 15317 ts_tablet_manager.cc:1939] T d797e53a027f476a85bcda79a5ee6ea4 P d9df91a6f9bd43889cff09a4997891ed: Deleting consensus metadata
I20260923 19:41:41.175948 14775 catalog_manager.cc:4841] TS d9df91a6f9bd43889cff09a4997891ed (127.13.88.193:44305): tablet d797e53a027f476a85bcda79a5ee6ea4 (table test-table [id=c92a7106c0964186844dc91579da6d58]) successfully deleted
I20260923 19:41:41.180735 15318 ts_tablet_manager.cc:1918] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:41.180894 15318 log.cc:1196] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/d797e53a027f476a85bcda79a5ee6ea4
I20260923 19:41:41.181370 15318 ts_tablet_manager.cc:1939] T d797e53a027f476a85bcda79a5ee6ea4 P a3d7bff71fe1454c917dbed668cff3de: Deleting consensus metadata
I20260923 19:41:41.182505 14777 catalog_manager.cc:4841] TS a3d7bff71fe1454c917dbed668cff3de (127.13.88.194:42397): tablet d797e53a027f476a85bcda79a5ee6ea4 (table test-table [id=c92a7106c0964186844dc91579da6d58]) successfully deleted
I20260923 19:41:41.183138 15316 ts_tablet_manager.cc:1918] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:41.183279 15316 log.cc:1196] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/d797e53a027f476a85bcda79a5ee6ea4
I20260923 19:41:41.183676 15316 ts_tablet_manager.cc:1939] T d797e53a027f476a85bcda79a5ee6ea4 P a8cb2d9a47d04bf2a1a1e258e8db6445: Deleting consensus metadata
I20260923 19:41:41.184514 14777 catalog_manager.cc:4841] TS a8cb2d9a47d04bf2a1a1e258e8db6445 (127.13.88.195:37529): tablet d797e53a027f476a85bcda79a5ee6ea4 (table test-table [id=c92a7106c0964186844dc91579da6d58]) successfully deleted
Sep 23 19:41:41 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192500, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:41.195869 15291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.166140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33530 (local address 127.13.88.193:44305)
0923 19:41:41.166299 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:41.166307 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:41.179752 (+ 13445us) server_negotiation.cc:407] Connection header received
0923 19:41:41.179981 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:41.179986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:41.180067 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:41.180176 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:41.182134 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.183312 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.185174 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.185553 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.185650 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.190321 (+ 4671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:41.190333 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:41.190347 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:41.190377 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:41.193164 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.193820 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.193828 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.193830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.193959 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.194329 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.194335 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.194338 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.194691 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:41.194991 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:41.195327 (+ 336us) server_negotiation.cc:299] Negotiation successful
0923 19:41:41.195540 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260923 19:41:41.196544 14992 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33530
I20260923 19:41:41.213721 14884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.199671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58690 (local address 127.13.88.254:42251)
0923 19:41:41.199898 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:41.199905 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:41.200089 (+ 184us) server_negotiation.cc:407] Connection header received
0923 19:41:41.200302 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:41.200306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:41.200367 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:41.200444 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:41.202099 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.202809 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.204632 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.205072 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.205158 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.207863 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:41.207868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:41.207871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:41.207898 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:41.210871 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.211682 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.211689 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.211694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.211842 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.212280 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.212289 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.212291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.212650 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:41.212874 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:41.213225 (+ 351us) server_negotiation.cc:299] Negotiation successful
0923 19:41:41.213429 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260923 19:41:41.214265 14788 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58690
I20260923 19:41:41.217756 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14861
I20260923 19:41:41.231427 15291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.218638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33546 (local address 127.13.88.193:44305)
0923 19:41:41.218786 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:41.218803 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:41.219159 (+ 356us) server_negotiation.cc:407] Connection header received
0923 19:41:41.219295 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:41.219298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:41.219357 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:41.219431 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:41.220828 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.221473 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.223196 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.223588 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.223674 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.226319 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:41.226323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:41.226326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:41.226355 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:41.228866 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.229624 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.229628 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.229630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.229739 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.230108 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.230111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.230113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.230344 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:41.230533 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:41.230879 (+ 346us) server_negotiation.cc:299] Negotiation successful
0923 19:41:41.231078 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260923 19:41:41.232044 14992 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33546
W20260923 19:41:41.232615 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14861: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:41.232810 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 14861
I20260923 19:41:41.254935 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15001
Sep 23 19:41:41 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192500, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:41:41.272109 15350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.255729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33524 (local address 127.13.88.194:42397)
0923 19:41:41.256244 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:41.256248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:41.256263 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:41:41.256312 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:41.256315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:41.256370 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:41.256456 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:41.257878 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.258552 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.260475 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.260869 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.260958 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.265771 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:41.265784 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:41.265800 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:41.265834 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:41.269026 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.269731 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.269738 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.269758 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.269934 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.270337 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.270341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.270345 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.270705 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:41.271070 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:41.271423 (+ 353us) server_negotiation.cc:299] Negotiation successful
0923 19:41:41.271653 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":276,"threads_started":1}
W20260923 19:41:41.272797 15131 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33524
W20260923 19:41:41.273435 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15001: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:41.273605 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 15001
I20260923 19:41:41.296146 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15140
Sep 23 19:41:41 dist-test-slave-xg7f krb5kdc[14745](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192500, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:41:41.311144 15290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:41.296894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41986 (local address 127.13.88.195:37529)
0923 19:41:41.297086 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:41.297092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:41.297111 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:41:41.297302 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:41.297307 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:41.297388 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:41.297502 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:41.298675 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.299578 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.300780 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:41.301196 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:41.301328 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:41.305379 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:41.305389 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:41.305403 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:41.305433 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:41.308286 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.308974 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.308989 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.308992 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.309133 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:41.309533 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:41.309538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:41.309542 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:41.309882 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:41.310311 (+ 429us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:41.310526 (+ 215us) server_negotiation.cc:299] Negotiation successful
0923 19:41:41.310781 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260923 19:41:41.311965 15270 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41986
W20260923 19:41:41.312603 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15140: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:41.312750 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 15140
I20260923 19:41:41.333920 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 14758
I20260923 19:41:41.334945 14830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:41.447192 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 14758
2026-09-23T19:41:41Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4288 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:41 dist-test-slave-xg7f krb5kdc[15354](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:41 dist-test-slave-xg7f krb5kdc[15354](info): set up 2 sockets
Sep 23 19:41:41 dist-test-slave-xg7f krb5kdc[15354](info): commencing operation
krb5kdc: starting...
W20260923 19:41:42.515349 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.005s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:42 dist-test-slave-xg7f krb5kdc[15354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:42.684281 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38071
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:38071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:42.994446 15367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:42.994794 15367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:42.994954 15367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:43.002130 15367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:43.002266 15367 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 19:41:43.002365 15367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:43.002480 15367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:43.002573 15367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:43.002658 15367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:43.012532 15367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:38071
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:43.013867 15367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:43.015385 15367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:43.026906 15372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:43.026871 15375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:43.026836 15373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:43.027648 15367 server_base.cc:1034] running on GCE node
I20260923 19:41:43.028424 15367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:43.029769 15367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:43.031008 15367 hybrid_clock.cc:648] HybridClock initialized: now 1790192503030949 us; error 44 us; skew 500 ppm
I20260923 19:41:43.031399 15367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:43 dist-test-slave-xg7f krb5kdc[15354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192503, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:43.034300 15367 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:41:43.035732 15367 webserver.cc:460] Webserver started at http://127.13.88.254:35841/ using document root <none> and password file <none>
I20260923 19:41:43.036417 15367 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:43.036543 15367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:43.036860 15367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:43.039759 15367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "7aa0bfaf835344bcbae64564d4a8fe65"
format_stamp: "Formatted at 2026-09-23 19:41:43 on dist-test-slave-xg7f"
server_key: "3c9232c6e8d990b3ddee39b786d815df"
server_key_iv: "f65368708b61870ba5314594b55accf1"
server_key_version: "encryptionkey@0"
I20260923 19:41:43.040515 15367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "7aa0bfaf835344bcbae64564d4a8fe65"
format_stamp: "Formatted at 2026-09-23 19:41:43 on dist-test-slave-xg7f"
server_key: "3c9232c6e8d990b3ddee39b786d815df"
server_key_iv: "f65368708b61870ba5314594b55accf1"
server_key_version: "encryptionkey@0"
I20260923 19:41:43.045581 15367 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:41:43.049053 15382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:43.050349 15367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:43.050532 15367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "7aa0bfaf835344bcbae64564d4a8fe65"
format_stamp: "Formatted at 2026-09-23 19:41:43 on dist-test-slave-xg7f"
server_key: "3c9232c6e8d990b3ddee39b786d815df"
server_key_iv: "f65368708b61870ba5314594b55accf1"
server_key_version: "encryptionkey@0"
I20260923 19:41:43.050755 15367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:43.072218 15367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:43.076167 15367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:43.076457 15367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:43.097976 15367 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:38071
I20260923 19:41:43.097987 15443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:38071 every 8 connection(s)
I20260923 19:41:43.099447 15367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:43.103471 15444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:43.109899 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 15367
I20260923 19:41:43.110090 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:41:43.110736 13667 external_mini_cluster.cc:1428] Setting key 16b818ecc2f3ba99f7c4139dacf23ff5
I20260923 19:41:43.114459 15444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Bootstrap starting.
I20260923 19:41:43.118379 15444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:43.119836 15444 log.cc:824] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:43.122768 15444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: No bootstrap required, opened a new log
Sep 23 19:41:43 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:43.132647 15444 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38071 } }
I20260923 19:41:43.133086 15444 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:43.133203 15444 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa0bfaf835344bcbae64564d4a8fe65, State: Initialized, Role: FOLLOWER
I20260923 19:41:43.133929 15444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38071 } }
I20260923 19:41:43.134199 15444 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:43.134351 15444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:43.134541 15444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:43.135775 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:43.112903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.13.88.254:38071)
0923 19:41:43.113750 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:43.113766 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:43.113817 (+ 51us) server_negotiation.cc:407] Connection header received
0923 19:41:43.116222 (+ 2405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:43.116260 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:43.116799 (+ 539us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:43.117260 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:43.118549 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.120607 (+ 2058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.121969 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.123005 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.123210 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:43.127185 (+ 3975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:43.127195 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:43.127215 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:43.127274 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:43.131208 (+ 3934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:43.131917 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:43.131925 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:43.131934 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:43.132126 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:43.132452 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:43.132457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:43.132460 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:43.133157 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:43.133424 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:43.133881 (+ 457us) server_negotiation.cc:299] Negotiation successful
0923 19:41:43.134338 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":364,"threads_started":1}
I20260923 19:41:43.137275 15444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38071 } }
I20260923 19:41:43.137729 15444 leader_election.cc:302] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aa0bfaf835344bcbae64564d4a8fe65; no voters:
I20260923 19:41:43.138243 15444 leader_election.cc:288] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:43.138430 15449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:43.139470 15449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa0bfaf835344bcbae64564d4a8fe65, State: Running, Role: LEADER
I20260923 19:41:43.140038 15449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38071 } }
I20260923 19:41:43.140408 15444 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:43.142771 15450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38071 } } }
I20260923 19:41:43.142968 15451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aa0bfaf835344bcbae64564d4a8fe65. Latest consensus state: current_term: 1 leader_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aa0bfaf835344bcbae64564d4a8fe65" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38071 } } }
I20260923 19:41:43.143236 15450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:43.143270 15451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:43.144048 15456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:43.149211 15456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:43.158892 15456 catalog_manager.cc:1347] Generated new cluster ID: ef3f795a3bc14d63b1d0b5755768f6fc
I20260923 19:41:43.159010 15456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:43.171911 15456 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:43.173403 15456 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:43.186615 15456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Generated new TSK 0
I20260923 19:41:43.187527 15456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:41:43.228258 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38071
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:43.544255 15470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:43.544538 15470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:43.544724 15470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:43.552228 15470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:43.552350 15470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:43.552489 15470 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 19:41:43.552549 15470 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:41:43.552661 15470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:41:43.562538 15470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:38071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:43.563925 15470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:43.565320 15470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:43.578083 15476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:43.578167 15475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:43.578143 15478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:43.579206 15470 server_base.cc:1034] running on GCE node
I20260923 19:41:43.579782 15470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:43.580691 15470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:43.581892 15470 hybrid_clock.cc:648] HybridClock initialized: now 1790192503581851 us; error 38 us; skew 500 ppm
I20260923 19:41:43.582194 15470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:43 dist-test-slave-xg7f krb5kdc[15354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192503, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:43.585314 15470 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:41:43.593549 15470 webserver.cc:460] Webserver started at http://127.13.88.193:38795/ using document root <none> and password file <none>
I20260923 19:41:43.594295 15470 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:43.594439 15470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:43.594776 15470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:43.597712 15470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "9b130b2fb61b453881d95d418ff72477"
format_stamp: "Formatted at 2026-09-23 19:41:43 on dist-test-slave-xg7f"
server_key: "cfca8fe952f0cb3f21d43827118e64e7"
server_key_iv: "ea96ee7be49cd65fc2b046cd7e8e5e26"
server_key_version: "encryptionkey@0"
I20260923 19:41:43.598443 15470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "9b130b2fb61b453881d95d418ff72477"
format_stamp: "Formatted at 2026-09-23 19:41:43 on dist-test-slave-xg7f"
server_key: "cfca8fe952f0cb3f21d43827118e64e7"
server_key_iv: "ea96ee7be49cd65fc2b046cd7e8e5e26"
server_key_version: "encryptionkey@0"
I20260923 19:41:43.603544 15470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:41:43.606794 15485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:43.608103 15470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:41:43.608276 15470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "9b130b2fb61b453881d95d418ff72477"
format_stamp: "Formatted at 2026-09-23 19:41:43 on dist-test-slave-xg7f"
server_key: "cfca8fe952f0cb3f21d43827118e64e7"
server_key_iv: "ea96ee7be49cd65fc2b046cd7e8e5e26"
server_key_version: "encryptionkey@0"
I20260923 19:41:43.608482 15470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:43.624529 15470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:43.628846 15470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:43.629142 15470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:43.631932 15470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:43.632095 15470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260923 19:41:43.632226 15470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:43.632325 15470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:41:43 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192503, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:43.658417 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:43.632880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:60539 (local address 127.13.88.254:38071)
0923 19:41:43.633039 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:43.633044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:43.634400 (+ 1356us) server_negotiation.cc:407] Connection header received
0923 19:41:43.636493 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:43.636498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:43.636588 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:43.636700 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:43.639130 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.640135 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.643741 (+ 3606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.644168 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.644321 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:43.652032 (+ 7711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:43.652037 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:43.652040 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:43.652070 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:43.655428 (+ 3358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:43.656124 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:43.656129 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:43.656132 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:43.656258 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:43.656727 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:43.656732 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:43.656735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:43.657011 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:43.657163 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:43.657857 (+ 694us) server_negotiation.cc:299] Negotiation successful
0923 19:41:43.658068 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 19:41:43.659710 15494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:43.633188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38071 (local address 127.13.88.193:60539)
0923 19:41:43.634212 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:43.634261 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:43.636192 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:43.636989 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:43.637001 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:43.637919 (+ 918us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:43.638911 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:43.638931 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.640354 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.640363 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:43.643467 (+ 3104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:43.643484 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.647402 (+ 3918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.647414 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:43.647698 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:43.648446 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:43.648467 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:43.651747 (+ 3280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:43.655579 (+ 3832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:43.655587 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:43.655603 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:43.655994 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:43.656396 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:43.656404 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:43.656408 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:43.656608 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:43.657138 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:43.657146 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:43.657491 (+ 345us) client_negotiation.cc:769] Sending connection context
0923 19:41:43.657737 (+ 246us) client_negotiation.cc:240] Negotiation successful
0923 19:41:43.658281 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":389,"threads_started":1}
I20260923 19:41:43.688635 15546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:43.672969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38071 (local address 127.13.88.193:34779)
0923 19:41:43.673697 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:43.673723 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:43.673979 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:43.674624 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:43.674629 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:43.675074 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:43.675593 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:43.675604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.677081 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.677088 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:43.678831 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:43.678848 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.679897 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.679904 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:43.680100 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:43.680741 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:43.680758 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:43.681900 (+ 1142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:43.685722 (+ 3822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:43.685729 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:43.685732 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:43.686289 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:43.686661 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:43.686667 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:43.686672 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:43.686839 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:43.687402 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:43.687407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:43.687658 (+ 251us) client_negotiation.cc:769] Sending connection context
0923 19:41:43.687843 (+ 185us) client_negotiation.cc:240] Negotiation successful
0923 19:41:43.688259 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":778,"threads_started":1}
I20260923 19:41:43.689054 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:43.672876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:34779 (local address 127.13.88.254:38071)
0923 19:41:43.673067 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:43.673073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:43.673833 (+ 760us) server_negotiation.cc:407] Connection header received
0923 19:41:43.674200 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:43.674205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:43.674296 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:43.674417 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:43.675789 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.676823 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.679017 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:43.679694 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:43.679839 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:43.682130 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:43.682134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:43.682137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:43.682168 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:43.685588 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:43.686409 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:43.686416 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:43.686419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:43.686553 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:43.686932 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:43.686938 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:43.686941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:43.687287 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:43.687438 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:43.688290 (+ 852us) server_negotiation.cc:299] Negotiation successful
0923 19:41:43.688593 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:41:43.698019 15470 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:41131
I20260923 19:41:43.698062 15604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:41131 every 8 connection(s)
I20260923 19:41:43.699309 15470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:41:43.701347 15605 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38071
I20260923 19:41:43.701535 15605 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:43.702123 15605 heartbeater.cc:511] Master 127.13.88.254:38071 requested a full tablet report, sending...
I20260923 19:41:43.703980 15399 ts_manager.cc:194] Registered new tserver with Master: 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131)
I20260923 19:41:43.705435 15399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:60539
I20260923 19:41:43.706598 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 15470
I20260923 19:41:43.706794 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:41:43.707451 13667 external_mini_cluster.cc:1428] Setting key e5e0a5c378dae1150bfe120d3ba44ecd
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:41:43.744436 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38071
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:44.069149 15609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:44.069670 15609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:44.069941 15609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:44.078727 15609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:44.078852 15609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:44.079012 15609 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 19:41:44.079094 15609 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:41:44.079248 15609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:41:44.088739 15609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:38071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:44.089953 15609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:44.091322 15609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:44.104514 15617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:44.104954 15615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:44.105189 15614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:44.106525 15609 server_base.cc:1034] running on GCE node
I20260923 19:41:44.107260 15609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:44.108202 15609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:44.109431 15609 hybrid_clock.cc:648] HybridClock initialized: now 1790192504109379 us; error 37 us; skew 500 ppm
I20260923 19:41:44.109740 15609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:44 dist-test-slave-xg7f krb5kdc[15354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192504, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:44.113186 15609 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:41:44.114842 15609 webserver.cc:460] Webserver started at http://127.13.88.194:43235/ using document root <none> and password file <none>
I20260923 19:41:44.115688 15609 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:44.115789 15609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:44.116040 15609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:44.118827 15609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8"
format_stamp: "Formatted at 2026-09-23 19:41:44 on dist-test-slave-xg7f"
server_key: "3e371e1efefd5253847af6e7bf63270b"
server_key_iv: "55cf099dda87a3248f284a903e91e2fa"
server_key_version: "encryptionkey@0"
I20260923 19:41:44.119653 15609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8"
format_stamp: "Formatted at 2026-09-23 19:41:44 on dist-test-slave-xg7f"
server_key: "3e371e1efefd5253847af6e7bf63270b"
server_key_iv: "55cf099dda87a3248f284a903e91e2fa"
server_key_version: "encryptionkey@0"
I20260923 19:41:44.124483 15609 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:41:44.127767 15624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:44.129070 15609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:44.129248 15609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8"
format_stamp: "Formatted at 2026-09-23 19:41:44 on dist-test-slave-xg7f"
server_key: "3e371e1efefd5253847af6e7bf63270b"
server_key_iv: "55cf099dda87a3248f284a903e91e2fa"
server_key_version: "encryptionkey@0"
I20260923 19:41:44.129451 15609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:44.145440 15609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:44.149200 15609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:44.149478 15609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:44.152236 15609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:44.152375 15609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:44.152509 15609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:44.152604 15609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:41:44 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192504, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:44.175635 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.152907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:56113 (local address 127.13.88.254:38071)
0923 19:41:44.153100 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.153106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.154562 (+ 1456us) server_negotiation.cc:407] Connection header received
0923 19:41:44.156746 (+ 2184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.156755 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.156853 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.156963 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:44.158412 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.159748 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.162460 (+ 2712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.163067 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.163257 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.168540 (+ 5283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:44.168545 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:44.168548 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:44.168584 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:44.172073 (+ 3489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.172898 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.172906 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.172913 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.173082 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.173688 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.173692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.173694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.174004 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:44.174129 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.175228 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.175401 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260923 19:41:44.177655 15633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.153494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38071 (local address 127.13.88.194:56113)
0923 19:41:44.154401 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.154454 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.156456 (+ 2002us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.157227 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.157235 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.157709 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:44.158239 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.158256 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.159936 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.159945 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.162311 (+ 2366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.162324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.163577 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.163591 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.163804 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.164669 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:44.164711 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:44.168305 (+ 3594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:44.172222 (+ 3917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.172233 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.172245 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.172759 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.173233 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.173241 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.173251 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.173561 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.174147 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:44.174158 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:44.174724 (+ 566us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.175143 (+ 419us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.175828 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":385,"threads_started":1}
I20260923 19:41:44.197052 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.183798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:47937 (local address 127.13.88.254:38071)
0923 19:41:44.183990 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.183998 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.184857 (+ 859us) server_negotiation.cc:407] Connection header received
0923 19:41:44.185046 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.185058 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.185125 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.185222 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:44.186076 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.186812 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.188944 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.189609 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.189741 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.191498 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:44.191504 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:44.191508 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:44.191545 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:44.194001 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.194715 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.194720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.194724 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.194840 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.195195 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.195203 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.195208 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.195581 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:44.195747 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.196348 (+ 601us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.196614 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 19:41:44.197330 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.183907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38071 (local address 127.13.88.194:47937)
0923 19:41:44.184764 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.184778 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.184936 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.185243 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.185247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.185677 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:44.185938 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.185946 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.186940 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.186947 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.188738 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.188758 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.189800 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.189807 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.189993 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.190600 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:44.190616 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:44.191331 (+ 715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:44.194137 (+ 2806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.194143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.194147 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.194593 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.194942 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.194946 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.194949 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.195071 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.195725 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:44.195733 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:44.196004 (+ 271us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.196201 (+ 197us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.196650 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":569,"threads_started":1}
I20260923 19:41:44.207692 15609 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:45951
I20260923 19:41:44.207720 15743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:45951 every 8 connection(s)
I20260923 19:41:44.208837 15609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:41:44.210726 15744 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38071
I20260923 19:41:44.210932 15744 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:44.211689 15744 heartbeater.cc:511] Master 127.13.88.254:38071 requested a full tablet report, sending...
I20260923 19:41:44.213059 15399 ts_manager.cc:194] Registered new tserver with Master: 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194:45951)
I20260923 19:41:44.213943 15399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:56113
I20260923 19:41:44.215200 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 15609
I20260923 19:41:44.215366 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:41:44.215803 13667 external_mini_cluster.cc:1428] Setting key 141d3434d4d77879ae50dccd95490d21
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:41:44.253548 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38071
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:44.566032 15748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:44.566318 15748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:44.566418 15748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:44.573681 15748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:44.573788 15748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:44.573871 15748 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 19:41:44.573922 15748 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:41:44.573989 15748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:41:44.584189 15748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:38071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:44.585383 15748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:44.586599 15748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:44.599030 15753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:44.598951 15756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:44.598997 15754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:44.600248 15748 server_base.cc:1034] running on GCE node
I20260923 19:41:44.600749 15748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:44.601557 15748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:44.602772 15748 hybrid_clock.cc:648] HybridClock initialized: now 1790192504602731 us; error 54 us; skew 500 ppm
I20260923 19:41:44.603072 15748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:44 dist-test-slave-xg7f krb5kdc[15354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192504, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:44.606087 15748 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:41:44.607498 15748 webserver.cc:460] Webserver started at http://127.13.88.195:45235/ using document root <none> and password file <none>
I20260923 19:41:44.608131 15748 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:44.608274 15748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:44.608570 15748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:44.611310 15748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "78de650a9b864b3ead135de020d263c2"
format_stamp: "Formatted at 2026-09-23 19:41:44 on dist-test-slave-xg7f"
server_key: "d2ffc4f3a107d688cf37b5d15355054e"
server_key_iv: "c84fd8362e0606098d22cb5bcbef4dbd"
server_key_version: "encryptionkey@0"
I20260923 19:41:44.612076 15748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "78de650a9b864b3ead135de020d263c2"
format_stamp: "Formatted at 2026-09-23 19:41:44 on dist-test-slave-xg7f"
server_key: "d2ffc4f3a107d688cf37b5d15355054e"
server_key_iv: "c84fd8362e0606098d22cb5bcbef4dbd"
server_key_version: "encryptionkey@0"
I20260923 19:41:44.616798 15748 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:41:44.620056 15763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:44.621189 15748 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 19:41:44.621377 15748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "78de650a9b864b3ead135de020d263c2"
format_stamp: "Formatted at 2026-09-23 19:41:44 on dist-test-slave-xg7f"
server_key: "d2ffc4f3a107d688cf37b5d15355054e"
server_key_iv: "c84fd8362e0606098d22cb5bcbef4dbd"
server_key_version: "encryptionkey@0"
I20260923 19:41:44.621587 15748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:44.646903 15748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:44.651347 15748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:44.651633 15748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:44.654325 15748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:44.654448 15748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:44.654587 15748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:44.654696 15748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:41:44 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192504, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:44.678522 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.654849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:46671 (local address 127.13.88.254:38071)
0923 19:41:44.655070 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.655075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.656557 (+ 1482us) server_negotiation.cc:407] Connection header received
0923 19:41:44.659593 (+ 3036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.659599 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.659685 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.659775 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:44.662576 (+ 2801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.663926 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.666225 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.666804 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.666943 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.670992 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:44.671003 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:44.671006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:44.671038 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:44.674353 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.675609 (+ 1256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.675614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.675618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.675779 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.676423 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.676427 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.676433 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.676868 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:44.677052 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.677696 (+ 644us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.678008 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:41:44.679219 15772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.655486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38071 (local address 127.13.88.195:46671)
0923 19:41:44.656368 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.656427 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.659219 (+ 2792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.660356 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.660369 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.661305 (+ 936us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:44.662316 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.662349 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.664084 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.664090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.666056 (+ 1966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.666073 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.667053 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.667060 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.667301 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.668167 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:44.668201 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:44.670752 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:44.674562 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.674576 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.674602 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.675409 (+ 807us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.675943 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.675951 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.675957 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.676267 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.676999 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:44.677004 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:44.677301 (+ 297us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.677525 (+ 224us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.677856 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":363,"threads_started":1}
I20260923 19:41:44.699584 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.685107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:34547 (local address 127.13.88.254:38071)
0923 19:41:44.685322 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.685330 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.685824 (+ 494us) server_negotiation.cc:407] Connection header received
0923 19:41:44.685950 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.685958 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.686051 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.686170 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:44.686939 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.688339 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.690266 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.691011 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.691178 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.693733 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:44.693739 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:44.693743 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:44.693782 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:44.696966 (+ 3184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.697705 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.697710 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.697714 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.697863 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.698217 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.698222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.698225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.698446 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:44.698584 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.698990 (+ 406us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.699207 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:41:44.699971 15842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.685137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38071 (local address 127.13.88.195:34547)
0923 19:41:44.685732 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.685755 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.685848 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.686187 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.686189 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.686570 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:44.686818 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.686825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.688478 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.688482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.690081 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.690100 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.691463 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.691471 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.691712 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.692575 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:44.692591 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:44.693562 (+ 971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:44.697091 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.697095 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.697099 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.697560 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.697982 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:44.697987 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:44.697990 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:44.698105 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:44.698550 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:44.698554 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:44.698726 (+ 172us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.698861 (+ 135us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.699527 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":328,"threads_started":1}
I20260923 19:41:44.708230 15605 heartbeater.cc:503] Master 127.13.88.254:38071 was elected leader, sending a full tablet report...
I20260923 19:41:44.710574 15748 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:33727
I20260923 19:41:44.710634 15882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:33727 every 8 connection(s)
I20260923 19:41:44.711705 15748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:41:44.713619 15883 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38071
I20260923 19:41:44.713788 15883 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:44.714321 15883 heartbeater.cc:511] Master 127.13.88.254:38071 requested a full tablet report, sending...
I20260923 19:41:44.715533 15399 ts_manager.cc:194] Registered new tserver with Master: 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:44.716311 15399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:46671
I20260923 19:41:44.720286 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 15748
I20260923 19:41:44.720474 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:41:44.720903 13667 external_mini_cluster.cc:1428] Setting key f8d5eed98b2dfca2e51d9ffb797f2f64
I20260923 19:41:44.723472 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:41:44 dist-test-slave-xg7f krb5kdc[15354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:41:44 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:44.767659 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.754367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51162 (local address 127.13.88.254:38071)
0923 19:41:44.754602 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.754611 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.754880 (+ 269us) server_negotiation.cc:407] Connection header received
0923 19:41:44.755143 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.755149 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.755219 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.755353 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:44.756708 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.757440 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.758667 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.759076 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.759250 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.762793 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:44.762798 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:44.762802 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:44.762848 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:44.765137 (+ 2289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.765725 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.765732 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.765735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.765859 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:44.766253 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:44.766259 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:44.766262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:44.766519 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:44.766760 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.767083 (+ 323us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.767331 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:41:44.771314 15399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51162:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:41:44.777861 15399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:44.824489 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.790131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44184 (local address 127.13.88.195:33727)
0923 19:41:44.815253 (+ 25122us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.815265 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.816365 (+ 1100us) server_negotiation.cc:407] Connection header received
0923 19:41:44.816484 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.816495 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.816805 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.817025 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:44.817990 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.819638 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.822030 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.823106 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.823247 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.823487 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.824008 (+ 521us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.824174 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24885,"thread_start_us":25142,"threads_started":1}
I20260923 19:41:44.824513 15897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.789436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:33727 (local address 127.0.0.1:44184)
0923 19:41:44.816027 (+ 26591us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.816050 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.816211 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.817228 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.817233 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.817257 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:44.817736 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.817751 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.819808 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.819813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.821887 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.821897 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.823642 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.823649 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.823808 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.823840 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.823962 (+ 122us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.824087 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26426,"mutex_wait_us":2,"thread_start_us":27584,"threads_started":1}
I20260923 19:41:44.825124 15898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.789638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41972 (local address 127.13.88.193:41131)
0923 19:41:44.815292 (+ 25654us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.815300 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.815331 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:41:44.815477 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.815487 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.815741 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.815943 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:44.816873 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.818560 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.821537 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.822914 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.823044 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.823264 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.824606 (+ 1342us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.824909 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25508,"thread_start_us":25312,"threads_started":1}
I20260923 19:41:44.825383 15899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.789241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41131 (local address 127.0.0.1:41972)
0923 19:41:44.814292 (+ 25051us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.814346 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.814619 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.816213 (+ 1594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.816222 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.816250 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:44.816689 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.816703 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.818704 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.818710 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.821367 (+ 2657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.821383 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.823398 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.823404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.823636 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.823694 (+ 58us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.823821 (+ 127us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.824009 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24707,"mutex_wait_us":55,"thread_start_us":28346,"threads_started":1}
I20260923 19:41:44.826334 15896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.789856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:45951 (local address 127.0.0.1:38034)
0923 19:41:44.818048 (+ 28192us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.818067 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.818196 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.818804 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.818809 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.818831 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:44.819271 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.819286 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.820748 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.820756 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.822649 (+ 1893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.822662 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.825511 (+ 2849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.825524 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.825707 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.825743 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.825841 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.825967 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28064,"thread_start_us":25381,"threads_started":1}
I20260923 19:41:44.826383 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.790402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38034 (local address 127.13.88.194:45951)
0923 19:41:44.813314 (+ 22912us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.813328 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.818189 (+ 4861us) server_negotiation.cc:407] Connection header received
0923 19:41:44.818397 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.818404 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.818608 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.818807 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:44.819443 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.820616 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.822840 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.824202 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.824328 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.824534 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.825915 (+ 1381us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.826092 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22665,"thread_start_us":22930,"threads_started":1}
I20260923 19:41:44.828984 15813 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc (DEFAULT_TABLE table=test-table [id=5db2344b3dfa4cdbb7f5819202d2ae35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:44.829234 15535 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc (DEFAULT_TABLE table=test-table [id=5db2344b3dfa4cdbb7f5819202d2ae35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:44.829284 15674 tablet_service.cc:1467] Processing CreateTablet for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc (DEFAULT_TABLE table=test-table [id=5db2344b3dfa4cdbb7f5819202d2ae35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:44.830425 15535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:44.830440 15813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:44.830503 15674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:44.841907 15902 tablet_bootstrap.cc:492] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Bootstrap starting.
I20260923 19:41:44.844669 15903 tablet_bootstrap.cc:492] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Bootstrap starting.
I20260923 19:41:44.845391 15902 tablet_bootstrap.cc:654] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:44.846804 15902 log.cc:824] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:44.847792 15904 tablet_bootstrap.cc:492] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Bootstrap starting.
I20260923 19:41:44.848220 15903 tablet_bootstrap.cc:654] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:44.849788 15903 log.cc:824] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:44.850775 15904 tablet_bootstrap.cc:654] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:44.852085 15904 log.cc:824] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:44.852695 15902 tablet_bootstrap.cc:492] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: No bootstrap required, opened a new log
I20260923 19:41:44.852936 15903 tablet_bootstrap.cc:492] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: No bootstrap required, opened a new log
I20260923 19:41:44.852981 15902 ts_tablet_manager.cc:1397] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260923 19:41:44.853127 15903 ts_tablet_manager.cc:1397] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:41:44.854956 15904 tablet_bootstrap.cc:492] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: No bootstrap required, opened a new log
I20260923 19:41:44.855224 15904 ts_tablet_manager.cc:1397] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:41:44.860526 15902 raft_consensus.cc:348] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.860862 15902 raft_consensus.cc:374] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:44.860962 15902 raft_consensus.cc:729] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Initialized, Role: FOLLOWER
I20260923 19:41:44.861574 15902 consensus_queue.cc:260] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.862685 15744 heartbeater.cc:503] Master 127.13.88.254:38071 was elected leader, sending a full tablet report...
I20260923 19:41:44.863332 15902 ts_tablet_manager.cc:1428] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260923 19:41:44.863353 15903 raft_consensus.cc:348] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.863790 15903 raft_consensus.cc:374] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:44.863890 15903 raft_consensus.cc:729] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b130b2fb61b453881d95d418ff72477, State: Initialized, Role: FOLLOWER
I20260923 19:41:44.864463 15903 consensus_queue.cc:260] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.866117 15903 ts_tablet_manager.cc:1428] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260923 19:41:44.866035 15904 raft_consensus.cc:348] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.866820 15904 raft_consensus.cc:374] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:44.866932 15904 raft_consensus.cc:729] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78de650a9b864b3ead135de020d263c2, State: Initialized, Role: FOLLOWER
I20260923 19:41:44.867487 15904 consensus_queue.cc:260] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.869505 15883 heartbeater.cc:503] Master 127.13.88.254:38071 was elected leader, sending a full tablet report...
I20260923 19:41:44.870041 15904 ts_tablet_manager.cc:1428] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260923 19:41:44.939590 15908 raft_consensus.cc:482] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:44.939975 15908 raft_consensus.cc:504] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.941757 15908 leader_election.cc:288] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:44.948431 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.942207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:40009 (local address 127.13.88.195:33727)
0923 19:41:44.942429 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.942438 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.943192 (+ 754us) server_negotiation.cc:407] Connection header received
0923 19:41:44.943385 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.943390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.943465 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.943563 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:44.944204 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.944889 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.946644 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.947494 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.947670 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.947756 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.948052 (+ 296us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.948174 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:41:44.948441 15898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.942095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:37229 (local address 127.13.88.193:41131)
0923 19:41:44.942310 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.942316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.943082 (+ 766us) server_negotiation.cc:407] Connection header received
0923 19:41:44.943309 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.943315 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.943397 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.943497 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:44.944108 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.944828 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.946639 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.947479 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.947674 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.947752 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:44.948047 (+ 295us) server_negotiation.cc:299] Negotiation successful
0923 19:41:44.948169 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:41:44.948657 15911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.942184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41131 (local address 127.13.88.194:37229)
0923 19:41:44.942965 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.942980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.943153 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.943510 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.943515 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.943536 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:44.943950 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.943960 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.944956 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.944963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.946489 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.946500 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.947722 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.947732 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.947887 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.947916 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.948021 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.948164 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":11,"spinlock_wait_cycles":3456,"thread_start_us":516,"threads_started":1}
I20260923 19:41:44.948678 15912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.942201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:33727 (local address 127.13.88.194:40009)
0923 19:41:44.943073 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.943091 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.943241 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.943589 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.943597 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.943646 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:44.944049 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.944057 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.945029 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.945036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.946499 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.946510 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.947745 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.947751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.947901 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:44.947923 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:41:44.948027 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 19:41:44.948151 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"mutex_wait_us":21,"spinlock_wait_cycles":4992,"thread_start_us":436,"threads_started":1}
I20260923 19:41:44.949729 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2bbb90372f4f44ba38c0c7ffce0dcc" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477" is_pre_election: true
I20260923 19:41:44.949865 15837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2bbb90372f4f44ba38c0c7ffce0dcc" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2" is_pre_election: true
I20260923 19:41:44.950372 15560 raft_consensus.cc:2454] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:44.950428 15837 raft_consensus.cc:2454] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:44.951058 15627 leader_election.cc:302] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:44.951577 15908 raft_consensus.cc:2781] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260923 19:41:44.951710 15606 tablet.cc:2369] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:41:44.951778 15908 raft_consensus.cc:482] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:44.951893 15908 raft_consensus.cc:3037] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:44.954319 15908 raft_consensus.cc:504] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
I20260923 19:41:44.954988 15908 leader_election.cc:288] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:44.955426 15837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2bbb90372f4f44ba38c0c7ffce0dcc" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2"
I20260923 19:41:44.955426 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c2bbb90372f4f44ba38c0c7ffce0dcc" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477"
I20260923 19:41:44.955623 15837 raft_consensus.cc:3037] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:44.955632 15560 raft_consensus.cc:3037] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:44.957726 15560 raft_consensus.cc:2454] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:44.957778 15837 raft_consensus.cc:2454] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:44.958092 15627 leader_election.cc:302] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:44.958356 15908 raft_consensus.cc:2781] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:44.958796 15908 raft_consensus.cc:686] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 LEADER]: Becoming Leader. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Running, Role: LEADER
I20260923 19:41:44.959324 15908 consensus_queue.cc:237] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } }
W20260923 19:41:44.960621 15745 tablet.cc:2369] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:41:44.963335 15884 tablet.cc:2369] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:41:44.964057 15398 catalog_manager.cc:5495] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } health_report { overall_health: HEALTHY } } }
Sep 23 19:41:45 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192503, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:45.011143 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.993434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51178 (local address 127.13.88.254:38071)
0923 19:41:44.993599 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:44.993603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:44.994136 (+ 533us) server_negotiation.cc:407] Connection header received
0923 19:41:44.994321 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:44.994324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:44.994380 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:44.994459 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:44.995628 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.996345 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.997578 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.997981 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.998068 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.005996 (+ 7928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:45.006001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:45.006004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:45.006031 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:45.008418 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:45.009108 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:45.009116 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:45.009121 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:45.009239 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:45.009618 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:45.009623 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:45.009626 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:45.009877 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:45.010025 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.010416 (+ 391us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.010693 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":56}
I20260923 19:41:45.011256 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:44.993496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38071 (local address 127.0.0.1:51178)
0923 19:41:44.994011 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:44.994027 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:44.994199 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:44.994525 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:44.994529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:44.995239 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:44.995505 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.995513 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.996477 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.996481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.997448 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:44.997459 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:44.998130 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:44.998134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:44.998248 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.003582 (+ 5334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:45.003604 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:45.005798 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:45.008558 (+ 2760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:45.008572 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:45.008580 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:45.008975 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:45.009361 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:45.009366 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:45.009370 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:45.009503 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:45.010002 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:45.010010 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:45.010187 (+ 177us) client_negotiation.cc:769] Sending connection context
0923 19:41:45.010345 (+ 158us) client_negotiation.cc:240] Negotiation successful
0923 19:41:45.010800 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":175,"thread_start_us":293,"threads_started":1}
I20260923 19:41:45.016129 15398 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:51178:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 19:41:45.017138 15398 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:45.023447 15674 tablet_service.cc:1467] Processing CreateTablet for tablet 31b567434bf34c989800ca12515cedb9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7629277f851d42bfacb5392eda4ad963]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:41:45.023399 15535 tablet_service.cc:1467] Processing CreateTablet for tablet 31b567434bf34c989800ca12515cedb9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7629277f851d42bfacb5392eda4ad963]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:41:45.023765 15813 tablet_service.cc:1467] Processing CreateTablet for tablet 31b567434bf34c989800ca12515cedb9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7629277f851d42bfacb5392eda4ad963]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:41:45.024430 15674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b567434bf34c989800ca12515cedb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:45.024421 15535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b567434bf34c989800ca12515cedb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:45.024724 15813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31b567434bf34c989800ca12515cedb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:45.030632 15904 tablet_bootstrap.cc:492] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: Bootstrap starting.
I20260923 19:41:45.031520 15903 tablet_bootstrap.cc:492] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: Bootstrap starting.
I20260923 19:41:45.032418 15902 tablet_bootstrap.cc:492] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Bootstrap starting.
I20260923 19:41:45.032501 15904 tablet_bootstrap.cc:654] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:45.033231 15903 tablet_bootstrap.cc:654] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:45.034053 15902 tablet_bootstrap.cc:654] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:45.034787 15904 tablet_bootstrap.cc:492] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: No bootstrap required, opened a new log
I20260923 19:41:45.034955 15904 ts_tablet_manager.cc:1397] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260923 19:41:45.035507 15903 tablet_bootstrap.cc:492] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: No bootstrap required, opened a new log
I20260923 19:41:45.035663 15903 ts_tablet_manager.cc:1397] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:41:45.036000 15904 raft_consensus.cc:348] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.036332 15904 raft_consensus.cc:374] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:45.036432 15904 raft_consensus.cc:729] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78de650a9b864b3ead135de020d263c2, State: Initialized, Role: FOLLOWER
I20260923 19:41:45.036360 15903 raft_consensus.cc:348] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.036684 15903 raft_consensus.cc:374] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:45.036783 15903 raft_consensus.cc:729] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b130b2fb61b453881d95d418ff72477, State: Initialized, Role: FOLLOWER
I20260923 19:41:45.036706 15904 consensus_queue.cc:260] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.037024 15903 consensus_queue.cc:260] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.037231 15910 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.037623 15910 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:45.037505 15909 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.037832 15909 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:45.038615 15904 ts_tablet_manager.cc:1428] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:41:45.038578 15903 ts_tablet_manager.cc:1428] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:45.040329 15902 tablet_bootstrap.cc:492] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: No bootstrap required, opened a new log
I20260923 19:41:45.040494 15902 ts_tablet_manager.cc:1397] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260923 19:41:45.041292 15902 raft_consensus.cc:348] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.041611 15902 raft_consensus.cc:374] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:45.041707 15902 raft_consensus.cc:729] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Initialized, Role: FOLLOWER
I20260923 19:41:45.041951 15902 consensus_queue.cc:260] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.042366 15908 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.042554 15902 ts_tablet_manager.cc:1428] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:41:45.042682 15908 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:45.128230 15908 raft_consensus.cc:482] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:45.128412 15908 raft_consensus.cc:504] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.128985 15908 leader_election.cc:288] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:45.129460 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b567434bf34c989800ca12515cedb9" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477" is_pre_election: true
I20260923 19:41:45.129495 15837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b567434bf34c989800ca12515cedb9" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2" is_pre_election: true
I20260923 19:41:45.129721 15560 raft_consensus.cc:2454] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:45.129760 15837 raft_consensus.cc:2454] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:45.130146 15627 leader_election.cc:302] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:45.130475 15908 raft_consensus.cc:2781] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:45.130579 15908 raft_consensus.cc:482] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:45.130656 15908 raft_consensus.cc:3037] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:45.132787 15908 raft_consensus.cc:504] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.133298 15908 leader_election.cc:288] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:45.133715 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b567434bf34c989800ca12515cedb9" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477"
I20260923 19:41:45.133744 15837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31b567434bf34c989800ca12515cedb9" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2"
I20260923 19:41:45.133936 15837 raft_consensus.cc:3037] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:45.133936 15560 raft_consensus.cc:3037] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:45.136822 15560 raft_consensus.cc:2454] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:45.136822 15837 raft_consensus.cc:2454] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:45.137229 15627 leader_election.cc:302] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 78de650a9b864b3ead135de020d263c2, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:45.137566 15908 raft_consensus.cc:2781] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:45.137777 15908 raft_consensus.cc:686] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 LEADER]: Becoming Leader. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Running, Role: LEADER
I20260923 19:41:45.138012 15908 consensus_queue.cc:237] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.139557 15913 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: TxnStatusTablet state changed. Reason: New leader 74b5c93e4dad4dd29a71872f2ecbb3f8. Latest consensus state: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.139894 15913 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:41:45.140596 15925 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 19:41:45.140887 15925 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 19:41:45.141340 15399 catalog_manager.cc:5495] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } health_report { overall_health: UNKNOWN } } }
I20260923 19:41:45.160148 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.153926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38038 (local address 127.13.88.194:45951)
0923 19:41:45.154126 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.154134 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.154298 (+ 164us) server_negotiation.cc:407] Connection header received
0923 19:41:45.154534 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.154537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.154610 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.154719 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:45.155171 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.156011 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.157947 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.158366 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.158482 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.159011 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.159613 (+ 602us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.159727 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.159874 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.159942 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:41:45.160413 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.153800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:45951 (local address 127.0.0.1:38038)
0923 19:41:45.154179 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:45.154199 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:45.154343 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:45.154777 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:45.154783 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:45.154797 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:41:45.155013 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.155024 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.156155 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.156162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.157803 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.157818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.158538 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.158544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.158749 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.158834 (+ 85us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.159728 (+ 894us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.159756 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 19:41:45.159848 (+ 92us) client_negotiation.cc:240] Negotiation successful
0923 19:41:45.160001 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195}
I20260923 19:41:45.167950 15837 raft_consensus.cc:1261] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:45.168046 15560 raft_consensus.cc:1261] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:45.168958 15913 consensus_queue.cc:1035] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:45.169373 15908 consensus_queue.cc:1035] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:45.179862 15909 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: TxnStatusTablet state changed. Reason: New leader 74b5c93e4dad4dd29a71872f2ecbb3f8. Latest consensus state: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.180171 15909 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:45.184077 15910 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: TxnStatusTablet state changed. Reason: New leader 74b5c93e4dad4dd29a71872f2ecbb3f8. Latest consensus state: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.184326 15910 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:45.190758 15913 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.191026 15913 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:41:45.193912 15913 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.194167 15913 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 74b5c93e4dad4dd29a71872f2ecbb3f8: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:41:45.197038 15909 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.197275 15909 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 9b130b2fb61b453881d95d418ff72477: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:45.200019 15910 tablet_replica.cc:439] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } } }
I20260923 19:41:45.200304 15910 tablet_replica.cc:442] T 31b567434bf34c989800ca12515cedb9 P 78de650a9b864b3ead135de020d263c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:41:45.210042 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.204215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38052 (local address 127.13.88.194:45951)
0923 19:41:45.204367 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.204371 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.204446 (+ 75us) server_negotiation.cc:407] Connection header received
0923 19:41:45.204618 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.204621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.204678 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.204762 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:45.205197 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.205966 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.207903 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.208627 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.208740 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.209225 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.209381 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.209475 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.209644 (+ 169us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.209719 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:41:45.230278 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.221718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:34803 (local address 127.13.88.194:45951)
0923 19:41:45.221903 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.221909 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.223700 (+ 1791us) server_negotiation.cc:407] Connection header received
0923 19:41:45.223853 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.223858 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.223943 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.224044 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:45.224712 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.225943 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.228154 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.228849 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.228971 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.229529 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.229665 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.229751 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.229890 (+ 139us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.229986 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 19:41:45.230419 15939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.221724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:45951 (local address 127.13.88.194:34803)
0923 19:41:45.223589 (+ 1865us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:45.223608 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:45.223738 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:45.224066 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:45.224071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:45.224084 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:41:45.224508 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.224519 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.226053 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.226059 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.228001 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.228014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.229034 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.229041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.229210 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.229280 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.229767 (+ 487us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.229777 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 19:41:45.229854 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 19:41:45.230008 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1705,"thread_start_us":1575,"threads_started":1}
I20260923 19:41:45.240700 15837 raft_consensus.cc:1261] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:45.240887 15560 raft_consensus.cc:1261] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:45.241402 15913 consensus_queue.cc:1035] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:45.241724 15908 consensus_queue.cc:1035] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:45.245957 15928 mvcc.cc:205] Tried to move back new op lower bound from 7332628501461602304 to 7332628500317323264. Current Snapshot: MvccSnapshot[applied={T|T < 7332628501461602304}]
I20260923 19:41:45.247972 15929 mvcc.cc:205] Tried to move back new op lower bound from 7332628501461602304 to 7332628500317323264. Current Snapshot: MvccSnapshot[applied={T|T < 7332628501461602304}]
I20260923 19:41:45.311896 15399 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:45.312206 15399 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:45.315752 15399 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Sending DeleteTablet for 3 replicas of tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc
I20260923 19:41:45.316687 15535 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:45 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41972
I20260923 19:41:45.316776 15813 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:45 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:44184
I20260923 19:41:45.316962 15674 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:45 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:38034
I20260923 19:41:45.318779 15399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51162:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:41:45.319558 15399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:45.330554 15534 tablet_service.cc:1467] Processing CreateTablet for tablet 542f44c6d63c4c99b1f5fec71b35841c (DEFAULT_TABLE table=test-table [id=bbd22d8017db47abaebfc14f16a5f351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:45.331199 15534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 542f44c6d63c4c99b1f5fec71b35841c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:45.332038 15945 tablet_replica.cc:330] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: stopping tablet replica
I20260923 19:41:45.332276 15947 tablet_replica.cc:330] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: stopping tablet replica
I20260923 19:41:45.332482 15945 raft_consensus.cc:2229] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:45.332974 15945 raft_consensus.cc:2258] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:45.332983 15947 raft_consensus.cc:2229] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:41:45.334038 15947 raft_consensus.cc:2258] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:45.335314 15945 ts_tablet_manager.cc:1905] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:45.335932 15812 tablet_service.cc:1467] Processing CreateTablet for tablet 542f44c6d63c4c99b1f5fec71b35841c (DEFAULT_TABLE table=test-table [id=bbd22d8017db47abaebfc14f16a5f351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:45.336436 15812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 542f44c6d63c4c99b1f5fec71b35841c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:45.337389 15947 ts_tablet_manager.cc:1905] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:45.340090 15673 tablet_service.cc:1467] Processing CreateTablet for tablet 542f44c6d63c4c99b1f5fec71b35841c (DEFAULT_TABLE table=test-table [id=bbd22d8017db47abaebfc14f16a5f351]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:45.340529 15673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 542f44c6d63c4c99b1f5fec71b35841c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:45.342530 15945 ts_tablet_manager.cc:1918] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:45.342690 15945 log.cc:1196] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/5c2bbb90372f4f44ba38c0c7ffce0dcc
I20260923 19:41:45.343228 15945 ts_tablet_manager.cc:1939] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 9b130b2fb61b453881d95d418ff72477: Deleting consensus metadata
I20260923 19:41:45.344972 15385 catalog_manager.cc:4841] TS 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131): tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc (table test-table [id=5db2344b3dfa4cdbb7f5819202d2ae35]) successfully deleted
I20260923 19:41:45.346638 15904 tablet_bootstrap.cc:492] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: Bootstrap starting.
I20260923 19:41:45.348778 15903 tablet_bootstrap.cc:492] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: Bootstrap starting.
I20260923 19:41:45.349107 15902 tablet_bootstrap.cc:492] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: Bootstrap starting.
I20260923 19:41:45.350159 15903 tablet_bootstrap.cc:654] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:45.350579 15902 tablet_bootstrap.cc:654] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:45.352331 15903 tablet_bootstrap.cc:492] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: No bootstrap required, opened a new log
I20260923 19:41:45.352624 15904 tablet_bootstrap.cc:654] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:45.352627 15903 ts_tablet_manager.cc:1397] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:41:45.353375 15903 raft_consensus.cc:348] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.353734 15903 raft_consensus.cc:374] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:45.353856 15903 raft_consensus.cc:729] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b130b2fb61b453881d95d418ff72477, State: Initialized, Role: FOLLOWER
I20260923 19:41:45.354146 15903 consensus_queue.cc:260] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.355376 15903 ts_tablet_manager.cc:1428] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:45.362085 15904 tablet_bootstrap.cc:492] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: No bootstrap required, opened a new log
I20260923 19:41:45.362188 15902 tablet_bootstrap.cc:492] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: No bootstrap required, opened a new log
I20260923 19:41:45.362246 15904 ts_tablet_manager.cc:1397] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.004s
I20260923 19:41:45.362421 15902 ts_tablet_manager.cc:1397] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260923 19:41:45.363123 15947 ts_tablet_manager.cc:1918] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:45.363296 15947 log.cc:1196] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/5c2bbb90372f4f44ba38c0c7ffce0dcc
I20260923 19:41:45.362984 15904 raft_consensus.cc:348] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.363348 15902 raft_consensus.cc:348] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.363629 15902 raft_consensus.cc:374] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:45.363634 15904 raft_consensus.cc:374] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:45.363722 15902 raft_consensus.cc:729] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Initialized, Role: FOLLOWER
I20260923 19:41:45.363831 15904 raft_consensus.cc:729] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78de650a9b864b3ead135de020d263c2, State: Initialized, Role: FOLLOWER
I20260923 19:41:45.363897 15947 ts_tablet_manager.cc:1939] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting consensus metadata
I20260923 19:41:45.364048 15902 consensus_queue.cc:260] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.364177 15904 consensus_queue.cc:260] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.365517 15904 ts_tablet_manager.cc:1428] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:45.366165 15946 tablet_replica.cc:330] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: stopping tablet replica
I20260923 19:41:45.366621 15902 ts_tablet_manager.cc:1428] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:41:45.367377 15946 raft_consensus.cc:2229] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:45.367713 15946 raft_consensus.cc:2258] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:45.369581 15384 catalog_manager.cc:4841] TS 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194:45951): tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc (table test-table [id=5db2344b3dfa4cdbb7f5819202d2ae35]) successfully deleted
I20260923 19:41:45.370536 15946 ts_tablet_manager.cc:1905] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:45.375932 15946 ts_tablet_manager.cc:1918] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:45.376082 15946 log.cc:1196] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/5c2bbb90372f4f44ba38c0c7ffce0dcc
I20260923 19:41:45.376502 15946 ts_tablet_manager.cc:1939] T 5c2bbb90372f4f44ba38c0c7ffce0dcc P 78de650a9b864b3ead135de020d263c2: Deleting consensus metadata
I20260923 19:41:45.378114 15386 catalog_manager.cc:4841] TS 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727): tablet 5c2bbb90372f4f44ba38c0c7ffce0dcc (table test-table [id=5db2344b3dfa4cdbb7f5819202d2ae35]) successfully deleted
I20260923 19:41:45.546795 15910 raft_consensus.cc:482] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:45.547034 15910 raft_consensus.cc:504] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.548671 15910 leader_election.cc:288] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194:45951)
I20260923 19:41:45.556643 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.549028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:49987 (local address 127.13.88.194:45951)
0923 19:41:45.549257 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.549267 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.549963 (+ 696us) server_negotiation.cc:407] Connection header received
0923 19:41:45.550252 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.550263 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.550347 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.550462 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:45.551297 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.552387 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.554333 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.555711 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.555869 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.555959 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.556238 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.556366 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:41:45.556931 15951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.548907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:45951 (local address 127.13.88.195:49987)
0923 19:41:45.549870 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:45.549889 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:45.550075 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:45.550629 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:45.550634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:45.550666 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:45.551012 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.551026 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.552518 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.552526 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.554160 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.554177 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.555872 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.555881 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.556061 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.556113 (+ 52us) client_negotiation.cc:769] Sending connection context
0923 19:41:45.556210 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 19:41:45.556343 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":848,"mutex_wait_us":22,"thread_start_us":478,"threads_started":1}
I20260923 19:41:45.556945 15952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.548857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41131 (local address 127.13.88.195:40125)
0923 19:41:45.549598 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:45.549619 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:45.549754 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:45.550423 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:45.550427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:45.550459 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:41:45.550684 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.550705 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.552333 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.552338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.554486 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.554501 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.556139 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.556148 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.556332 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.556363 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:41:45.556451 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 19:41:45.556580 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":39,"thread_start_us":764,"threads_started":1}
I20260923 19:41:45.557337 15953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.549312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:40125 (local address 127.13.88.193:41131)
0923 19:41:45.550155 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.550161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.550186 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:41:45.550250 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.550253 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.550303 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.550407 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:41:45.550932 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.552188 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.554648 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.555897 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.556052 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.556125 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.557002 (+ 877us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.557113 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":620,"threads_started":1}
I20260923 19:41:45.558041 15699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "542f44c6d63c4c99b1f5fec71b35841c" candidate_uuid: "78de650a9b864b3ead135de020d263c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" is_pre_election: true
I20260923 19:41:45.558208 15559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "542f44c6d63c4c99b1f5fec71b35841c" candidate_uuid: "78de650a9b864b3ead135de020d263c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477" is_pre_election: true
I20260923 19:41:45.558445 15559 raft_consensus.cc:2454] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78de650a9b864b3ead135de020d263c2 in term 0.
I20260923 19:41:45.558457 15699 raft_consensus.cc:2454] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78de650a9b864b3ead135de020d263c2 in term 0.
I20260923 19:41:45.558923 15766 leader_election.cc:302] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78de650a9b864b3ead135de020d263c2, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:45.559378 15910 raft_consensus.cc:2781] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:45.559509 15910 raft_consensus.cc:482] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:45.559621 15910 raft_consensus.cc:3037] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:45.561702 15910 raft_consensus.cc:504] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.562285 15910 leader_election.cc:288] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [CANDIDATE]: Term 1 election: Requested vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194:45951)
I20260923 19:41:45.562847 15559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "542f44c6d63c4c99b1f5fec71b35841c" candidate_uuid: "78de650a9b864b3ead135de020d263c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477"
I20260923 19:41:45.563028 15559 raft_consensus.cc:3037] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:45.563329 15699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "542f44c6d63c4c99b1f5fec71b35841c" candidate_uuid: "78de650a9b864b3ead135de020d263c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8"
I20260923 19:41:45.563536 15699 raft_consensus.cc:3037] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:45.565140 15559 raft_consensus.cc:2454] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78de650a9b864b3ead135de020d263c2 in term 1.
I20260923 19:41:45.565492 15766 leader_election.cc:302] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78de650a9b864b3ead135de020d263c2, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:45.565769 15910 raft_consensus.cc:2781] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:45.566275 15910 raft_consensus.cc:686] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 1 LEADER]: Becoming Leader. State: Replica: 78de650a9b864b3ead135de020d263c2, State: Running, Role: LEADER
I20260923 19:41:45.566679 15699 raft_consensus.cc:2454] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78de650a9b864b3ead135de020d263c2 in term 1.
I20260923 19:41:45.566685 15910 consensus_queue.cc:237] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:45.570212 15397 catalog_manager.cc:5495] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78de650a9b864b3ead135de020d263c2 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "78de650a9b864b3ead135de020d263c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } health_report { overall_health: HEALTHY } } }
I20260923 19:41:45.608306 15956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.601839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44194 (local address 127.13.88.195:33727)
0923 19:41:45.602510 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.602516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.602538 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:41:45.602641 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.602647 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.602745 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.602911 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:45.603305 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.604487 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.605734 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.606363 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.606487 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.606874 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.607633 (+ 759us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.607775 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.607837 (+ 62us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.607912 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":432,"threads_started":1}
I20260923 19:41:45.624465 15959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.618195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:45951 (local address 127.13.88.195:56397)
0923 19:41:45.618842 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:45.618860 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:45.618969 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:45.619359 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:45.619365 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:45.619377 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:41:45.619711 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.619719 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.621168 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.621171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.622184 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.622195 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.623252 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.623265 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.623465 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.623534 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.623963 (+ 429us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.623977 (+ 14us) client_negotiation.cc:769] Sending connection context
0923 19:41:45.624035 (+ 58us) client_negotiation.cc:240] Negotiation successful
0923 19:41:45.624132 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":384,"threads_started":1}
I20260923 19:41:45.624485 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.618292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:56397 (local address 127.13.88.194:45951)
0923 19:41:45.618461 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.618466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.618953 (+ 487us) server_negotiation.cc:407] Connection header received
0923 19:41:45.619076 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.619081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.619204 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.619326 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:45.619877 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.621050 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.622318 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.623015 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.623171 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.623723 (+ 552us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.623867 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.623967 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.624089 (+ 122us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.624173 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:41:45.633262 15559 raft_consensus.cc:1261] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Refusing update from remote peer 78de650a9b864b3ead135de020d263c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:45.633587 15699 raft_consensus.cc:1261] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Refusing update from remote peer 78de650a9b864b3ead135de020d263c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:45.634002 15954 consensus_queue.cc:1035] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:45.634387 15910 consensus_queue.cc:1035] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:45.673666 15956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.667396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:52841 (local address 127.13.88.195:33727)
0923 19:41:45.667551 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:45.667556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:45.667573 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:41:45.667737 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:45.667742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:45.667818 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:45.667898 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:45.668506 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.669623 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.671666 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.672320 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.672446 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.672984 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.673122 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.673217 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:45.673371 (+ 154us) server_negotiation.cc:299] Negotiation successful
0923 19:41:45.673437 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 19:41:45.673825 15939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:45.667061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:33727 (local address 127.13.88.194:52841)
0923 19:41:45.667443 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:45.667475 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:45.667585 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:45.668054 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:45.668059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:45.668074 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:41:45.668298 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.668309 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.669782 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.669790 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.671507 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:45.671521 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:45.672572 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:45.672578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:45.672750 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:45.672805 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:41:45.673238 (+ 433us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:41:45.673269 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:41:45.673356 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 19:41:45.673500 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
W20260923 19:41:45.675004 15929 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 19:41:47.270133 15397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:47.270406 15397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:47.274221 15397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Sending DeleteTablet for 3 replicas of tablet 542f44c6d63c4c99b1f5fec71b35841c
I20260923 19:41:47.274911 15534 tablet_service.cc:1514] Processing DeleteTablet for tablet 542f44c6d63c4c99b1f5fec71b35841c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:47 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41972
I20260923 19:41:47.275024 15673 tablet_service.cc:1514] Processing DeleteTablet for tablet 542f44c6d63c4c99b1f5fec71b35841c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:47 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:38034
I20260923 19:41:47.275149 15813 tablet_service.cc:1514] Processing DeleteTablet for tablet 542f44c6d63c4c99b1f5fec71b35841c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:47 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:44184
I20260923 19:41:47.285838 15987 tablet_replica.cc:330] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: stopping tablet replica
I20260923 19:41:47.286029 15985 tablet_replica.cc:330] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: stopping tablet replica
I20260923 19:41:47.286219 15986 tablet_replica.cc:330] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: stopping tablet replica
I20260923 19:41:47.286207 15987 raft_consensus.cc:2229] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:41:47.286304 15985 raft_consensus.cc:2229] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:47.286478 15986 raft_consensus.cc:2229] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:47.286599 15985 raft_consensus.cc:2258] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:47.286744 15986 raft_consensus.cc:2258] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:47.286751 15987 raft_consensus.cc:2258] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:47.287779 15985 ts_tablet_manager.cc:1905] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:47.287779 15986 ts_tablet_manager.cc:1905] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:47.287799 15987 ts_tablet_manager.cc:1905] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:47.294365 15986 ts_tablet_manager.cc:1918] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:41:47.294365 15985 ts_tablet_manager.cc:1918] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:41:47.294512 15985 log.cc:1196] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/542f44c6d63c4c99b1f5fec71b35841c
I20260923 19:41:47.294577 15986 log.cc:1196] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/542f44c6d63c4c99b1f5fec71b35841c
I20260923 19:41:47.295071 15985 ts_tablet_manager.cc:1939] T 542f44c6d63c4c99b1f5fec71b35841c P 9b130b2fb61b453881d95d418ff72477: Deleting consensus metadata
I20260923 19:41:47.295080 15986 ts_tablet_manager.cc:1939] T 542f44c6d63c4c99b1f5fec71b35841c P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting consensus metadata
I20260923 19:41:47.295207 15987 ts_tablet_manager.cc:1918] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:41:47.295419 15987 log.cc:1196] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/542f44c6d63c4c99b1f5fec71b35841c
I20260923 19:41:47.295941 15987 ts_tablet_manager.cc:1939] T 542f44c6d63c4c99b1f5fec71b35841c P 78de650a9b864b3ead135de020d263c2: Deleting consensus metadata
I20260923 19:41:47.296193 15385 catalog_manager.cc:4841] TS 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131): tablet 542f44c6d63c4c99b1f5fec71b35841c (table test-table [id=bbd22d8017db47abaebfc14f16a5f351]) successfully deleted
I20260923 19:41:47.296193 15384 catalog_manager.cc:4841] TS 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194:45951): tablet 542f44c6d63c4c99b1f5fec71b35841c (table test-table [id=bbd22d8017db47abaebfc14f16a5f351]) successfully deleted
I20260923 19:41:47.297106 15386 catalog_manager.cc:4841] TS 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727): tablet 542f44c6d63c4c99b1f5fec71b35841c (table test-table [id=bbd22d8017db47abaebfc14f16a5f351]) successfully deleted
Sep 23 19:41:47 dist-test-slave-xg7f krb5kdc[15354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:41:47 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:47.329229 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:47.315670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51192 (local address 127.13.88.254:38071)
0923 19:41:47.316248 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:47.316255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:47.316358 (+ 103us) server_negotiation.cc:407] Connection header received
0923 19:41:47.316588 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:47.316591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:47.316653 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:47.316766 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:47.317989 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:47.318731 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:47.320088 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:47.320441 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:47.320573 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:47.324446 (+ 3873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:47.324452 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:47.324456 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:47.324497 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:47.327058 (+ 2561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:47.327700 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:47.327704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:47.327706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:47.327823 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:47.328125 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:47.328128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:47.328130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:47.328384 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:47.328561 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:47.328815 (+ 254us) server_negotiation.cc:299] Negotiation successful
0923 19:41:47.328973 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":289,"threads_started":1}
I20260923 19:41:47.332605 15397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:41:47.333217 15397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:47.339498 15534 tablet_service.cc:1467] Processing CreateTablet for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 (DEFAULT_TABLE table=test-table [id=449407c4493d40bf952c6a10626104f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:47.339637 15673 tablet_service.cc:1467] Processing CreateTablet for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 (DEFAULT_TABLE table=test-table [id=449407c4493d40bf952c6a10626104f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:47.339990 15534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:47.340082 15673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:47.339990 15813 tablet_service.cc:1467] Processing CreateTablet for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 (DEFAULT_TABLE table=test-table [id=449407c4493d40bf952c6a10626104f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:47.340368 15813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:47.346484 15996 tablet_bootstrap.cc:492] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: Bootstrap starting.
I20260923 19:41:47.347654 15998 tablet_bootstrap.cc:492] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: Bootstrap starting.
I20260923 19:41:47.348222 15997 tablet_bootstrap.cc:492] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Bootstrap starting.
I20260923 19:41:47.348237 15996 tablet_bootstrap.cc:654] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:47.350032 15997 tablet_bootstrap.cc:654] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:47.350389 15996 tablet_bootstrap.cc:492] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: No bootstrap required, opened a new log
I20260923 19:41:47.350548 15996 ts_tablet_manager.cc:1397] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:41:47.351019 15998 tablet_bootstrap.cc:654] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:47.351338 15996 raft_consensus.cc:348] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.351614 15996 raft_consensus.cc:374] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:47.351714 15996 raft_consensus.cc:729] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b130b2fb61b453881d95d418ff72477, State: Initialized, Role: FOLLOWER
I20260923 19:41:47.352082 15996 consensus_queue.cc:260] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.352592 15997 tablet_bootstrap.cc:492] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: No bootstrap required, opened a new log
I20260923 19:41:47.352823 15997 ts_tablet_manager.cc:1397] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260923 19:41:47.354056 15996 ts_tablet_manager.cc:1428] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260923 19:41:47.353871 15997 raft_consensus.cc:348] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.354166 15997 raft_consensus.cc:374] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:47.354343 15997 raft_consensus.cc:729] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Initialized, Role: FOLLOWER
I20260923 19:41:47.354694 15997 consensus_queue.cc:260] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.355520 15997 ts_tablet_manager.cc:1428] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:41:47.359477 15998 tablet_bootstrap.cc:492] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: No bootstrap required, opened a new log
I20260923 19:41:47.359615 15998 ts_tablet_manager.cc:1397] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20260923 19:41:47.360162 15998 raft_consensus.cc:348] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.360332 15998 raft_consensus.cc:374] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:47.360397 15998 raft_consensus.cc:729] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78de650a9b864b3ead135de020d263c2, State: Initialized, Role: FOLLOWER
I20260923 19:41:47.360631 15998 consensus_queue.cc:260] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.361086 15998 ts_tablet_manager.cc:1428] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:41:47.509217 15943 raft_consensus.cc:482] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:47.509469 15943 raft_consensus.cc:504] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.510186 15943 leader_election.cc:288] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:47.510785 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dfb4323442b4a8baa2ea9f9d60c25f2" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477" is_pre_election: true
I20260923 19:41:47.510785 15832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dfb4323442b4a8baa2ea9f9d60c25f2" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2" is_pre_election: true
I20260923 19:41:47.511026 15832 raft_consensus.cc:2454] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:47.511026 15560 raft_consensus.cc:2454] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:47.511505 15627 leader_election.cc:302] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:47.511849 15943 raft_consensus.cc:2781] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:47.512037 15943 raft_consensus.cc:482] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:47.512128 15943 raft_consensus.cc:3037] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:47.514442 15943 raft_consensus.cc:504] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.515039 15943 leader_election.cc:288] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:47.515491 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dfb4323442b4a8baa2ea9f9d60c25f2" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477"
I20260923 19:41:47.515630 15832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7dfb4323442b4a8baa2ea9f9d60c25f2" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2"
I20260923 19:41:47.515714 15560 raft_consensus.cc:3037] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:47.515836 15832 raft_consensus.cc:3037] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:47.518667 15560 raft_consensus.cc:2454] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:47.518667 15832 raft_consensus.cc:2454] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:47.519078 15628 leader_election.cc:302] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 78de650a9b864b3ead135de020d263c2, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:47.519464 15943 raft_consensus.cc:2781] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:47.519629 15943 raft_consensus.cc:686] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 LEADER]: Becoming Leader. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Running, Role: LEADER
I20260923 19:41:47.519936 15943 consensus_queue.cc:237] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.522532 15399 catalog_manager.cc:5495] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } health_report { overall_health: UNKNOWN } } }
I20260923 19:41:47.547194 16005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:47.542494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38066 (local address 127.13.88.194:45951)
0923 19:41:47.543059 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:47.543063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:47.543081 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:41:47.543150 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:47.543153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:47.543210 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:47.543288 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:41:47.543639 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:47.544429 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:47.545635 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:47.546057 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:47.546146 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:47.546505 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:41:47.546605 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:41:47.546669 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:47.546798 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 19:41:47.546855 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":326,"threads_started":1}
I20260923 19:41:47.555344 15832 raft_consensus.cc:1261] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:47.555459 15560 raft_consensus.cc:1261] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:47.555899 15971 consensus_queue.cc:1035] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:47.556200 15966 consensus_queue.cc:1035] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:47.563792 15968 mvcc.cc:205] Tried to move back new op lower bound from 7332628510941847552 to 7332628510803546112. Current Snapshot: MvccSnapshot[applied={T|T < 7332628510941847552}]
I20260923 19:41:47.597018 15397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:47.597223 15397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:47.599781 15397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Sending DeleteTablet for 3 replicas of tablet 7dfb4323442b4a8baa2ea9f9d60c25f2
I20260923 19:41:47.600502 15674 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:47 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:38034
I20260923 19:41:47.600499 15534 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:47 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41972
I20260923 19:41:47.600656 15813 tablet_service.cc:1514] Processing DeleteTablet for tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:47 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:44184
I20260923 19:41:47.600765 15985 tablet_replica.cc:330] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: stopping tablet replica
I20260923 19:41:47.600764 15986 tablet_replica.cc:330] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: stopping tablet replica
I20260923 19:41:47.600909 15987 tablet_replica.cc:330] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: stopping tablet replica
I20260923 19:41:47.600957 15986 raft_consensus.cc:2229] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:41:47.600955 15985 raft_consensus.cc:2229] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:47.601047 15987 raft_consensus.cc:2229] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:47.601123 15985 raft_consensus.cc:2258] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:47.601173 15987 raft_consensus.cc:2258] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:47.601258 15986 raft_consensus.cc:2258] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:47.602089 15987 ts_tablet_manager.cc:1905] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:47.602632 15985 ts_tablet_manager.cc:1905] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:47.602766 15397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:41:47.603408 15397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:41:47.607329 15987 ts_tablet_manager.cc:1918] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:47.607465 15987 log.cc:1196] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/7dfb4323442b4a8baa2ea9f9d60c25f2
I20260923 19:41:47.607859 15987 ts_tablet_manager.cc:1939] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 78de650a9b864b3ead135de020d263c2: Deleting consensus metadata
I20260923 19:41:47.608044 15985 ts_tablet_manager.cc:1918] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:47.608176 15985 log.cc:1196] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/7dfb4323442b4a8baa2ea9f9d60c25f2
I20260923 19:41:47.608606 15985 ts_tablet_manager.cc:1939] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 9b130b2fb61b453881d95d418ff72477: Deleting consensus metadata
I20260923 19:41:47.608866 15386 catalog_manager.cc:4841] TS 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727): tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 (table test-table [id=449407c4493d40bf952c6a10626104f5]) successfully deleted
I20260923 19:41:47.609767 15986 ts_tablet_manager.cc:1905] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:47.610570 15674 tablet_service.cc:1467] Processing CreateTablet for tablet 782abde30ab9432b8ae2e876d8067684 (DEFAULT_TABLE table=test-table [id=572b55f8955b462ba7747806856b18f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:47.610718 15813 tablet_service.cc:1467] Processing CreateTablet for tablet 782abde30ab9432b8ae2e876d8067684 (DEFAULT_TABLE table=test-table [id=572b55f8955b462ba7747806856b18f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:47.610961 15674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 782abde30ab9432b8ae2e876d8067684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:47.611121 15813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 782abde30ab9432b8ae2e876d8067684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:47.613507 15534 tablet_service.cc:1467] Processing CreateTablet for tablet 782abde30ab9432b8ae2e876d8067684 (DEFAULT_TABLE table=test-table [id=572b55f8955b462ba7747806856b18f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:41:47.613874 15534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 782abde30ab9432b8ae2e876d8067684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:47.616183 15998 tablet_bootstrap.cc:492] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: Bootstrap starting.
I20260923 19:41:47.617751 15998 tablet_bootstrap.cc:654] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:47.618606 15997 tablet_bootstrap.cc:492] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Bootstrap starting.
I20260923 19:41:47.618795 15986 ts_tablet_manager.cc:1918] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:41:47.618960 15986 log.cc:1196] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/7dfb4323442b4a8baa2ea9f9d60c25f2
I20260923 19:41:47.620100 15385 catalog_manager.cc:4841] TS 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131): tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 (table test-table [id=449407c4493d40bf952c6a10626104f5]) successfully deleted
I20260923 19:41:47.620162 15997 tablet_bootstrap.cc:654] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:47.620244 15986 ts_tablet_manager.cc:1939] T 7dfb4323442b4a8baa2ea9f9d60c25f2 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting consensus metadata
I20260923 19:41:47.620805 15998 tablet_bootstrap.cc:492] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: No bootstrap required, opened a new log
I20260923 19:41:47.620939 15998 ts_tablet_manager.cc:1397] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260923 19:41:47.620983 15996 tablet_bootstrap.cc:492] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: Bootstrap starting.
I20260923 19:41:47.621309 15384 catalog_manager.cc:4841] TS 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194:45951): tablet 7dfb4323442b4a8baa2ea9f9d60c25f2 (table test-table [id=449407c4493d40bf952c6a10626104f5]) successfully deleted
I20260923 19:41:47.621668 15998 raft_consensus.cc:348] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.621899 15998 raft_consensus.cc:374] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:47.621986 15998 raft_consensus.cc:729] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78de650a9b864b3ead135de020d263c2, State: Initialized, Role: FOLLOWER
I20260923 19:41:47.622225 15998 consensus_queue.cc:260] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.622439 15996 tablet_bootstrap.cc:654] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:47.622676 15998 ts_tablet_manager.cc:1428] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:41:47.624279 15997 tablet_bootstrap.cc:492] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: No bootstrap required, opened a new log
I20260923 19:41:47.624490 15997 ts_tablet_manager.cc:1397] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260923 19:41:47.625262 15997 raft_consensus.cc:348] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.625499 15997 raft_consensus.cc:374] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:47.625573 15997 raft_consensus.cc:729] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Initialized, Role: FOLLOWER
I20260923 19:41:47.625783 15997 consensus_queue.cc:260] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.626217 15997 ts_tablet_manager.cc:1428] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:41:47.632261 15996 tablet_bootstrap.cc:492] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: No bootstrap required, opened a new log
I20260923 19:41:47.632388 15996 ts_tablet_manager.cc:1397] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260923 19:41:47.632925 15996 raft_consensus.cc:348] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.633138 15996 raft_consensus.cc:374] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:47.633230 15996 raft_consensus.cc:729] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b130b2fb61b453881d95d418ff72477, State: Initialized, Role: FOLLOWER
I20260923 19:41:47.633492 15996 consensus_queue.cc:260] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.634008 15996 ts_tablet_manager.cc:1428] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:41:47.908740 15971 raft_consensus.cc:482] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:41:47.908985 15971 raft_consensus.cc:504] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.909679 15971 leader_election.cc:288] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:47.910266 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "782abde30ab9432b8ae2e876d8067684" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477" is_pre_election: true
I20260923 19:41:47.910315 15832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "782abde30ab9432b8ae2e876d8067684" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2" is_pre_election: true
I20260923 19:41:47.910496 15560 raft_consensus.cc:2454] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:47.910589 15832 raft_consensus.cc:2454] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 0.
I20260923 19:41:47.910975 15627 leader_election.cc:302] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 9b130b2fb61b453881d95d418ff72477; no voters:
I20260923 19:41:47.911310 15971 raft_consensus.cc:2781] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:41:47.911391 15971 raft_consensus.cc:482] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:41:47.911506 15971 raft_consensus.cc:3037] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:47.913702 15971 raft_consensus.cc:504] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.914265 15971 leader_election.cc:288] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Requested vote from peers 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131), 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727)
I20260923 19:41:47.914705 15560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "782abde30ab9432b8ae2e876d8067684" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b130b2fb61b453881d95d418ff72477"
I20260923 19:41:47.914753 15832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "782abde30ab9432b8ae2e876d8067684" candidate_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78de650a9b864b3ead135de020d263c2"
I20260923 19:41:47.914932 15560 raft_consensus.cc:3037] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:47.914937 15832 raft_consensus.cc:3037] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:47.917843 15560 raft_consensus.cc:2454] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:47.917845 15832 raft_consensus.cc:2454] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b5c93e4dad4dd29a71872f2ecbb3f8 in term 1.
I20260923 19:41:47.918252 15628 leader_election.cc:302] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b5c93e4dad4dd29a71872f2ecbb3f8, 78de650a9b864b3ead135de020d263c2; no voters:
I20260923 19:41:47.918519 15971 raft_consensus.cc:2781] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:47.918735 15971 raft_consensus.cc:686] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 LEADER]: Becoming Leader. State: Replica: 74b5c93e4dad4dd29a71872f2ecbb3f8, State: Running, Role: LEADER
I20260923 19:41:47.919018 15971 consensus_queue.cc:237] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } }
I20260923 19:41:47.921545 15398 catalog_manager.cc:5495] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b5c93e4dad4dd29a71872f2ecbb3f8" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 } health_report { overall_health: UNKNOWN } } }
I20260923 19:41:47.999081 15832 raft_consensus.cc:1261] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:47.999181 15560 raft_consensus.cc:1261] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Refusing update from remote peer 74b5c93e4dad4dd29a71872f2ecbb3f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:41:47.999707 15943 consensus_queue.cc:1035] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b130b2fb61b453881d95d418ff72477" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:41:47.999972 15971 consensus_queue.cc:1035] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78de650a9b864b3ead135de020d263c2" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 33727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:41:48.020211 15964 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 19:41:49.602753 15397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:49.603003 15397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:41:49.606873 15397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7aa0bfaf835344bcbae64564d4a8fe65: Sending DeleteTablet for 3 replicas of tablet 782abde30ab9432b8ae2e876d8067684
I20260923 19:41:49.607717 15534 tablet_service.cc:1514] Processing DeleteTablet for tablet 782abde30ab9432b8ae2e876d8067684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:49 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41972
I20260923 19:41:49.607825 15674 tablet_service.cc:1514] Processing DeleteTablet for tablet 782abde30ab9432b8ae2e876d8067684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:49 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:38034
I20260923 19:41:49.607932 15813 tablet_service.cc:1514] Processing DeleteTablet for tablet 782abde30ab9432b8ae2e876d8067684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:41:49 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:44184
I20260923 19:41:49.608871 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15470
I20260923 19:41:49.620159 16035 tablet_replica.cc:330] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: stopping tablet replica
I20260923 19:41:49.620378 16037 tablet_replica.cc:330] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: stopping tablet replica
I20260923 19:41:49.620513 16035 raft_consensus.cc:2229] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:49.620798 16037 raft_consensus.cc:2229] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:41:49.620865 16035 raft_consensus.cc:2258] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:49.621134 16037 raft_consensus.cc:2258] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:49.622099 16035 ts_tablet_manager.cc:1905] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:49.622828 16037 ts_tablet_manager.cc:1905] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:41:49.630741 16035 ts_tablet_manager.cc:1918] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:41:49.631012 16035 log.cc:1196] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/782abde30ab9432b8ae2e876d8067684
I20260923 19:41:49.631664 16035 ts_tablet_manager.cc:1939] T 782abde30ab9432b8ae2e876d8067684 P 9b130b2fb61b453881d95d418ff72477: Deleting consensus metadata
I20260923 19:41:49.632283 16037 ts_tablet_manager.cc:1918] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:41:49.632531 16037 log.cc:1196] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/782abde30ab9432b8ae2e876d8067684
I20260923 19:41:49.633195 16037 ts_tablet_manager.cc:1939] T 782abde30ab9432b8ae2e876d8067684 P 78de650a9b864b3ead135de020d263c2: Deleting consensus metadata
I20260923 19:41:49.634277 15385 catalog_manager.cc:4841] TS 9b130b2fb61b453881d95d418ff72477 (127.13.88.193:41131): tablet 782abde30ab9432b8ae2e876d8067684 (table test-table [id=572b55f8955b462ba7747806856b18f8]) successfully deleted
I20260923 19:41:49.634764 15386 catalog_manager.cc:4841] TS 78de650a9b864b3ead135de020d263c2 (127.13.88.195:33727): tablet 782abde30ab9432b8ae2e876d8067684 (table test-table [id=572b55f8955b462ba7747806856b18f8]) successfully deleted
I20260923 19:41:49.636442 16036 tablet_replica.cc:330] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: stopping tablet replica
I20260923 19:41:49.636662 16036 raft_consensus.cc:2229] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:41:49.637022 16036 raft_consensus.cc:2258] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:41:49.637955 16036 ts_tablet_manager.cc:1905] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:41:49 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:49.643457 16036 ts_tablet_manager.cc:1918] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 19:41:49.643595 16036 log.cc:1196] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/782abde30ab9432b8ae2e876d8067684
I20260923 19:41:49.644063 16036 ts_tablet_manager.cc:1939] T 782abde30ab9432b8ae2e876d8067684 P 74b5c93e4dad4dd29a71872f2ecbb3f8: Deleting consensus metadata
I20260923 19:41:49.645246 15384 catalog_manager.cc:4841] TS 74b5c93e4dad4dd29a71872f2ecbb3f8 (127.13.88.194:45951): tablet 782abde30ab9432b8ae2e876d8067684 (table test-table [id=572b55f8955b462ba7747806856b18f8]) successfully deleted
I20260923 19:41:49.649278 16039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:49.612407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41974 (local address 127.13.88.193:41131)
0923 19:41:49.634204 (+ 21797us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:49.634209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:49.634231 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:41:49.634288 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:49.634294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:49.634380 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:49.634484 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:49.636065 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:49.637178 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:49.638615 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:49.639292 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:49.639424 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:49.643565 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:49.643587 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:49.643610 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:49.643666 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:49.646880 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:49.647577 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:49.647584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:49.647586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:49.647710 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:49.648020 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:49.648023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:49.648025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:49.648336 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:49.648567 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:49.648750 (+ 183us) server_negotiation.cc:299] Negotiation successful
0923 19:41:49.648902 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21651,"thread_start_us":21544,"threads_started":1}
W20260923 19:41:49.649912 15600 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41974
W20260923 19:41:49.650522 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15470: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:49.650743 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 15470
I20260923 19:41:49.670883 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15609
Sep 23 19:41:49 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:41:49.686281 16040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:49.671898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38080 (local address 127.13.88.194:45951)
0923 19:41:49.672849 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:49.672853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:49.672870 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:41:49.672925 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:49.672928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:49.672991 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:49.673093 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:49.674394 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:49.675334 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:49.676465 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:49.676877 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:49.676966 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:49.681021 (+ 4055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:49.681042 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:49.681057 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:49.681089 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:49.684071 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:49.684644 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:49.684651 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:49.684653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:49.684769 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:49.685058 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:49.685061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:49.685063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:49.685405 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:49.685614 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:49.685813 (+ 199us) server_negotiation.cc:299] Negotiation successful
0923 19:41:49.685965 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":680,"threads_started":1}
W20260923 19:41:49.687127 15739 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38080
W20260923 19:41:49.687734 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15609: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:49.687862 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 15609
I20260923 19:41:49.713517 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15748
Sep 23 19:41:49 dist-test-slave-xg7f krb5kdc[15354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:41:49.731237 16041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:49.714326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44196 (local address 127.13.88.195:33727)
0923 19:41:49.714886 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:49.714892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:49.714921 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:41:49.714988 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:49.714993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:49.715082 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:49.715226 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:49.716459 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:49.717640 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:49.718841 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:49.719555 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:49.719668 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:49.724061 (+ 4393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:49.724083 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:49.724105 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:49.724153 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:49.728174 (+ 4021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:49.729058 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:49.729069 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:49.729073 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:49.729246 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:49.729603 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:49.729608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:49.729612 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:49.730082 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:49.730336 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:49.730570 (+ 234us) server_negotiation.cc:299] Negotiation successful
0923 19:41:49.730813 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":289,"threads_started":1}
W20260923 19:41:49.732072 15878 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44196
W20260923 19:41:49.732795 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15748: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:49.732957 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 15748
I20260923 19:41:49.754789 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 15367
I20260923 19:41:49.756006 15439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:49.871295 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 15367
2026-09-23T19:41:49Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8425 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:49 dist-test-slave-xg7f krb5kdc[16045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:49 dist-test-slave-xg7f krb5kdc[16045](info): set up 2 sockets
Sep 23 19:41:49 dist-test-slave-xg7f krb5kdc[16045](info): commencing operation
krb5kdc: starting...
W20260923 19:41:50.955331 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:51 dist-test-slave-xg7f krb5kdc[16045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:51.136407 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:39143
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:39143
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:51.448570 16058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:51.448939 16058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:51.449097 16058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:51.456228 16058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:51.456387 16058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:51.456491 16058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:51.456596 16058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:51.456686 16058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:51.466423 16058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:39143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:39143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:51.467844 16058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:51.469165 16058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:51.481567 16063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:51.481454 16064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:51.481505 16066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:51.482193 16058 server_base.cc:1034] running on GCE node
I20260923 19:41:51.483044 16058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:51.484537 16058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:51.485780 16058 hybrid_clock.cc:648] HybridClock initialized: now 1790192511485742 us; error 46 us; skew 500 ppm
I20260923 19:41:51.486131 16058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:51 dist-test-slave-xg7f krb5kdc[16045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192511, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:51.494263 16058 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:41:51.495857 16058 webserver.cc:460] Webserver started at http://127.13.88.254:40667/ using document root <none> and password file <none>
I20260923 19:41:51.496569 16058 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:51.496711 16058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:51.497020 16058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:51.500090 16058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "78e43c47e1ae4ea1a7eb3def71314f0b"
format_stamp: "Formatted at 2026-09-23 19:41:51 on dist-test-slave-xg7f"
server_key: "7470dfd67f9c6772b62802a897677b68"
server_key_iv: "c7fc0c7143686cba3bf6f3ad27737e3f"
server_key_version: "encryptionkey@0"
I20260923 19:41:51.500866 16058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "78e43c47e1ae4ea1a7eb3def71314f0b"
format_stamp: "Formatted at 2026-09-23 19:41:51 on dist-test-slave-xg7f"
server_key: "7470dfd67f9c6772b62802a897677b68"
server_key_iv: "c7fc0c7143686cba3bf6f3ad27737e3f"
server_key_version: "encryptionkey@0"
I20260923 19:41:51.506156 16058 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:41:51.509622 16073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:51.510919 16058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:51.511140 16058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "78e43c47e1ae4ea1a7eb3def71314f0b"
format_stamp: "Formatted at 2026-09-23 19:41:51 on dist-test-slave-xg7f"
server_key: "7470dfd67f9c6772b62802a897677b68"
server_key_iv: "c7fc0c7143686cba3bf6f3ad27737e3f"
server_key_version: "encryptionkey@0"
I20260923 19:41:51.511345 16058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:51.530640 16058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:51.534884 16058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:51.535214 16058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:51.553448 16058 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:39143
I20260923 19:41:51.553514 16124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:39143 every 8 connection(s)
I20260923 19:41:51.554890 16058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:51.558709 16125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:51.564131 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16058
I20260923 19:41:51.564350 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:41:51.565155 13667 external_mini_cluster.cc:1428] Setting key 5e5af5fc55b64d589c022882bd4d5142
I20260923 19:41:51.570075 16125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b: Bootstrap starting.
I20260923 19:41:51.573756 16125 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:51.575070 16125 log.cc:824] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:51.578308 16125 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b: No bootstrap required, opened a new log
Sep 23 19:41:51 dist-test-slave-xg7f krb5kdc[16045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:51.586472 16125 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39143 } }
I20260923 19:41:51.586843 16125 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:51.586980 16125 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e43c47e1ae4ea1a7eb3def71314f0b, State: Initialized, Role: FOLLOWER
I20260923 19:41:51.587687 16125 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39143 } }
I20260923 19:41:51.587976 16125 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:51.588142 16125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:51.588341 16125 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:51.588933 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:51.567381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56730 (local address 127.13.88.254:39143)
0923 19:41:51.568247 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:51.568259 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:51.568298 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:41:51.569912 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:51.569934 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:51.570386 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:51.570700 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:51.572618 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:51.573971 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:51.575799 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:51.576739 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:51.576867 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:51.581283 (+ 4416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:51.581292 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:51.581307 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:51.581344 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:51.584528 (+ 3184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:51.585256 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:51.585263 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:51.585269 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:51.585448 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:51.585842 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:51.585847 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:51.585849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:51.586377 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:51.586691 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:51.587090 (+ 399us) server_negotiation.cc:299] Negotiation successful
0923 19:41:51.587591 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":439,"threads_started":1}
I20260923 19:41:51.591270 16125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39143 } }
I20260923 19:41:51.591892 16125 leader_election.cc:302] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78e43c47e1ae4ea1a7eb3def71314f0b; no voters:
I20260923 19:41:51.592492 16125 leader_election.cc:288] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:51.592623 16130 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:51.593312 16130 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [term 1 LEADER]: Becoming Leader. State: Replica: 78e43c47e1ae4ea1a7eb3def71314f0b, State: Running, Role: LEADER
I20260923 19:41:51.593845 16130 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39143 } }
I20260923 19:41:51.594568 16125 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:51.596948 16131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39143 } } }
I20260923 19:41:51.597548 16131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:51.597417 16132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78e43c47e1ae4ea1a7eb3def71314f0b. Latest consensus state: current_term: 1 leader_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78e43c47e1ae4ea1a7eb3def71314f0b" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39143 } } }
I20260923 19:41:51.597805 16132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:51.604960 16136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:51.609769 16136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:51.619092 16136 catalog_manager.cc:1347] Generated new cluster ID: 7b4c3672e6a843fd91e479bc616fe362
I20260923 19:41:51.619239 16136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:51.636615 16136 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:51.637974 16136 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:51.646028 16136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78e43c47e1ae4ea1a7eb3def71314f0b: Generated new TSK 0
I20260923 19:41:51.646919 16136 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:41:51.694551 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39143
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:52.018689 16151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:52.019043 16151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:52.019227 16151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:52.026592 16151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:52.026739 16151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:52.026952 16151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:41:52.036863 16151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:52.038231 16151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:52.039587 16151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:52.053146 16159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:52.053201 16157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:52.053376 16156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:52.054095 16151 server_base.cc:1034] running on GCE node
I20260923 19:41:52.054699 16151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:52.055689 16151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:52.056895 16151 hybrid_clock.cc:648] HybridClock initialized: now 1790192512056823 us; error 63 us; skew 500 ppm
I20260923 19:41:52.057253 16151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:52 dist-test-slave-xg7f krb5kdc[16045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192512, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:52.060402 16151 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:41:52.061932 16151 webserver.cc:460] Webserver started at http://127.13.88.193:37791/ using document root <none> and password file <none>
I20260923 19:41:52.062620 16151 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:52.062736 16151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:52.063006 16151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:52.065930 16151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "0a6b2a05af7d469fa44648b515437b4a"
format_stamp: "Formatted at 2026-09-23 19:41:52 on dist-test-slave-xg7f"
server_key: "b7cac36f4841db96bea264b63b399e28"
server_key_iv: "3cf04b99402772dde61967edb3792083"
server_key_version: "encryptionkey@0"
I20260923 19:41:52.066743 16151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "0a6b2a05af7d469fa44648b515437b4a"
format_stamp: "Formatted at 2026-09-23 19:41:52 on dist-test-slave-xg7f"
server_key: "b7cac36f4841db96bea264b63b399e28"
server_key_iv: "3cf04b99402772dde61967edb3792083"
server_key_version: "encryptionkey@0"
I20260923 19:41:52.072045 16151 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260923 19:41:52.075488 16166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:52.076977 16151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:41:52.077148 16151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "0a6b2a05af7d469fa44648b515437b4a"
format_stamp: "Formatted at 2026-09-23 19:41:52 on dist-test-slave-xg7f"
server_key: "b7cac36f4841db96bea264b63b399e28"
server_key_iv: "3cf04b99402772dde61967edb3792083"
server_key_version: "encryptionkey@0"
I20260923 19:41:52.077365 16151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:52.097730 16151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:52.101686 16151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:52.102003 16151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:52.102949 16151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:52.104344 16151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:52.104445 16151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:52.104592 16151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:52.104663 16151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:52.137990 16151 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:42031
I20260923 19:41:52.138084 16278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:42031 every 8 connection(s)
I20260923 19:41:52.139323 16151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:41:52.144196 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16151
I20260923 19:41:52.144413 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:41:52.145066 13667 external_mini_cluster.cc:1428] Setting key 9de0e945626bf1bc94884e9c1113b402
Sep 23 19:41:52 dist-test-slave-xg7f krb5kdc[16045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192512, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:52.161037 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:52.141939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:33279 (local address 127.13.88.254:39143)
0923 19:41:52.142350 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:52.142355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:52.143435 (+ 1080us) server_negotiation.cc:407] Connection header received
0923 19:41:52.145396 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:52.145401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:52.145490 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:52.145604 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:52.147344 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.148148 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.149860 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.150280 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.150438 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:52.153961 (+ 3523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:52.153971 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:52.153978 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:52.154024 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:52.157632 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:52.158372 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:52.158380 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:52.158385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:52.158528 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:52.158924 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:52.158932 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:52.158939 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:52.159373 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:52.159533 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:52.160239 (+ 706us) server_negotiation.cc:299] Negotiation successful
0923 19:41:52.160515 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":210,"threads_started":1}
I20260923 19:41:52.161792 16282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:52.142525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:39143 (local address 127.13.88.193:33279)
0923 19:41:52.143272 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:52.143311 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:52.145079 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:52.145868 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:52.145878 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:52.146462 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:52.147182 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:52.147203 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.148347 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.148357 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:52.149711 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:52.149723 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.150518 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.150526 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:52.150773 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:52.151534 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:52.151563 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:52.153741 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:52.157784 (+ 4043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:52.157792 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:52.157806 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:52.158234 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:52.158630 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:52.158633 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:52.158636 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:52.158810 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:52.159492 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:52.159498 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:52.159825 (+ 327us) client_negotiation.cc:769] Sending connection context
0923 19:41:52.160062 (+ 237us) client_negotiation.cc:240] Negotiation successful
0923 19:41:52.160491 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":257,"threads_started":1}
I20260923 19:41:52.163446 16279 heartbeater.cc:347] Connected to a master server at 127.13.88.254:39143
I20260923 19:41:52.163794 16279 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:52.164741 16279 heartbeater.cc:511] Master 127.13.88.254:39143 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:41:52.166983 16090 ts_manager.cc:194] Registered new tserver with Master: 0a6b2a05af7d469fa44648b515437b4a (127.13.88.193:42031)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
I20260923 19:41:52.169210 16090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:33279
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:41:52.190213 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39143
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:52.510002 16285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:52.510339 16285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:52.510510 16285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:52.517864 16285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:52.518014 16285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:52.518189 16285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:41:52.528008 16285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:52.529362 16285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:52.530674 16285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:52.543787 16293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:52.543819 16291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:52.543898 16290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:52.548434 16285 server_base.cc:1034] running on GCE node
I20260923 19:41:52.549006 16285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:52.549952 16285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:52.551196 16285 hybrid_clock.cc:648] HybridClock initialized: now 1790192512551129 us; error 60 us; skew 500 ppm
I20260923 19:41:52.551517 16285 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:52 dist-test-slave-xg7f krb5kdc[16045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192512, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:52.554631 16285 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:41:52.556183 16285 webserver.cc:460] Webserver started at http://127.13.88.194:46757/ using document root <none> and password file <none>
I20260923 19:41:52.556926 16285 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:52.557060 16285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:52.557340 16285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:52.560158 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "7a24726e17254b61b69aeeecd6fe959b"
format_stamp: "Formatted at 2026-09-23 19:41:52 on dist-test-slave-xg7f"
server_key: "d28bffe406b4a7679d65163b22af6455"
server_key_iv: "b38e82037cf8eeae63dc909cd2b768d3"
server_key_version: "encryptionkey@0"
I20260923 19:41:52.560894 16285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "7a24726e17254b61b69aeeecd6fe959b"
format_stamp: "Formatted at 2026-09-23 19:41:52 on dist-test-slave-xg7f"
server_key: "d28bffe406b4a7679d65163b22af6455"
server_key_iv: "b38e82037cf8eeae63dc909cd2b768d3"
server_key_version: "encryptionkey@0"
I20260923 19:41:52.565855 16285 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:41:52.569188 16300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:52.570396 16285 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260923 19:41:52.570568 16285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "7a24726e17254b61b69aeeecd6fe959b"
format_stamp: "Formatted at 2026-09-23 19:41:52 on dist-test-slave-xg7f"
server_key: "d28bffe406b4a7679d65163b22af6455"
server_key_iv: "b38e82037cf8eeae63dc909cd2b768d3"
server_key_version: "encryptionkey@0"
I20260923 19:41:52.570770 16285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:52.596661 16285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:52.600875 16285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:52.601195 16285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:52.602181 16285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:52.603602 16285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:52.603706 16285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:52.603853 16285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:52.603924 16285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:52.637108 16285 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:38611
I20260923 19:41:52.637157 16412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:38611 every 8 connection(s)
I20260923 19:41:52.638432 16285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:41:52.648067 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16285
I20260923 19:41:52.648272 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:41:52.648816 13667 external_mini_cluster.cc:1428] Setting key f8a1d5ce2c9e8d4db74f3c1108854e7f
Sep 23 19:41:52 dist-test-slave-xg7f krb5kdc[16045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192512, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:52.658859 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:52.641062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:47897 (local address 127.13.88.254:39143)
0923 19:41:52.641269 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:52.641276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:52.642449 (+ 1173us) server_negotiation.cc:407] Connection header received
0923 19:41:52.644321 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:52.644326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:52.644399 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:52.644491 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:52.645931 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.646700 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.648767 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.649302 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.649467 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:52.653121 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:52.653127 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:52.653130 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:52.653162 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:52.655755 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:52.656520 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:52.656530 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:52.656532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:52.656660 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:52.657109 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:52.657116 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:52.657123 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:52.657392 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:52.657544 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:52.658268 (+ 724us) server_negotiation.cc:299] Negotiation successful
0923 19:41:52.658508 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:41:52.659931 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:52.641594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:39143 (local address 127.13.88.194:47897)
0923 19:41:52.642275 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:52.642320 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:52.644064 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:52.644698 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:52.644706 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:52.645225 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:52.645784 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:52.645801 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.646844 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.646848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:52.648565 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:52.648588 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:52.649564 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:52.649572 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:52.649853 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:52.650589 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:52.650613 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:52.652874 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:52.655931 (+ 3057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:52.655943 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:52.655963 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:52.656387 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:52.656779 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:52.656784 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:52.656788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:52.656987 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:52.657522 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:52.657531 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:52.657905 (+ 374us) client_negotiation.cc:769] Sending connection context
0923 19:41:52.658181 (+ 276us) client_negotiation.cc:240] Negotiation successful
0923 19:41:52.658748 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":259,"threads_started":1}
I20260923 19:41:52.661561 16413 heartbeater.cc:347] Connected to a master server at 127.13.88.254:39143
I20260923 19:41:52.661882 16413 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:52.662734 16413 heartbeater.cc:511] Master 127.13.88.254:39143 requested a full tablet report, sending...
I20260923 19:41:52.664345 16090 ts_manager.cc:194] Registered new tserver with Master: 7a24726e17254b61b69aeeecd6fe959b (127.13.88.194:38611)
I20260923 19:41:52.665150 16090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:47897
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:41:52.690063 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39143
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:53.016256 16418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:53.016528 16418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:53.016621 16418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:53.023790 16418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:53.023923 16418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:53.024050 16418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:41:53.034055 16418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:53.035368 16418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:53.036847 16418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:53.049944 16423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:53.050066 16426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:53.050263 16424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:53.051056 16418 server_base.cc:1034] running on GCE node
I20260923 19:41:53.051712 16418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:53.052692 16418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:53.053916 16418 hybrid_clock.cc:648] HybridClock initialized: now 1790192513053868 us; error 45 us; skew 500 ppm
I20260923 19:41:53.054246 16418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:53 dist-test-slave-xg7f krb5kdc[16045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192513, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:53.057333 16418 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:41:53.058729 16418 webserver.cc:460] Webserver started at http://127.13.88.195:46629/ using document root <none> and password file <none>
I20260923 19:41:53.059506 16418 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:53.059643 16418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:53.059939 16418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:53.062777 16418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "7551835d979140fca8261b2adc3db6ee"
format_stamp: "Formatted at 2026-09-23 19:41:53 on dist-test-slave-xg7f"
server_key: "6a34e9876e778f04c0cad8dbd23c5174"
server_key_iv: "be8455868830e149df89591836696ca0"
server_key_version: "encryptionkey@0"
I20260923 19:41:53.063645 16418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "7551835d979140fca8261b2adc3db6ee"
format_stamp: "Formatted at 2026-09-23 19:41:53 on dist-test-slave-xg7f"
server_key: "6a34e9876e778f04c0cad8dbd23c5174"
server_key_iv: "be8455868830e149df89591836696ca0"
server_key_version: "encryptionkey@0"
I20260923 19:41:53.068681 16418 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:41:53.072031 16433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:53.073335 16418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:41:53.073504 16418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "7551835d979140fca8261b2adc3db6ee"
format_stamp: "Formatted at 2026-09-23 19:41:53 on dist-test-slave-xg7f"
server_key: "6a34e9876e778f04c0cad8dbd23c5174"
server_key_iv: "be8455868830e149df89591836696ca0"
server_key_version: "encryptionkey@0"
I20260923 19:41:53.073710 16418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:53.113406 16418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:53.117848 16418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:53.118155 16418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:53.119161 16418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:53.120471 16418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:53.120581 16418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:53.120736 16418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:53.120815 16418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:53.154119 16418 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:46047
I20260923 19:41:53.154167 16545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:46047 every 8 connection(s)
I20260923 19:41:53.155542 16418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:41:53.158952 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16418
I20260923 19:41:53.159201 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:41:53.159636 13667 external_mini_cluster.cc:1428] Setting key 401ec3ad445da52eeae0f2f1f8167b5e
Sep 23 19:41:53 dist-test-slave-xg7f krb5kdc[16045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192513, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:53.172370 16279 heartbeater.cc:503] Master 127.13.88.254:39143 was elected leader, sending a full tablet report...
I20260923 19:41:53.175340 16281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:53.158003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:48741 (local address 127.13.88.254:39143)
0923 19:41:53.158218 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:53.158224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:53.159535 (+ 1311us) server_negotiation.cc:407] Connection header received
0923 19:41:53.161816 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:53.161820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:53.161905 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:53.161985 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:53.163652 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:53.164387 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:53.165828 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:53.166226 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:53.166314 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:53.169531 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:53.169535 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:53.169539 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:53.169569 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:53.171910 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:53.172645 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:53.172650 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:53.172654 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:53.172800 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:53.173322 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:53.173327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:53.173330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:53.173800 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:53.173938 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:53.174731 (+ 793us) server_negotiation.cc:299] Negotiation successful
0923 19:41:53.174978 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:41:53.176395 16548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:53.158551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:39143 (local address 127.13.88.195:48741)
0923 19:41:53.159384 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:53.159433 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:53.161549 (+ 2116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:53.162246 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:53.162258 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:53.162900 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:53.163515 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:53.163531 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:53.164515 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:53.164518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:53.165716 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:53.165726 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:53.166399 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:53.166403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:53.166590 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:53.167245 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:53.167267 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:53.169326 (+ 2059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:53.172057 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:53.172066 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:53.172082 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:53.172480 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:53.172923 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:53.172931 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:53.172937 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:53.173189 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:53.173959 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:53.173966 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:53.174361 (+ 395us) client_negotiation.cc:769] Sending connection context
0923 19:41:53.174655 (+ 294us) client_negotiation.cc:240] Negotiation successful
0923 19:41:53.175198 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":360,"threads_started":1}
I20260923 19:41:53.177641 16546 heartbeater.cc:347] Connected to a master server at 127.13.88.254:39143
I20260923 19:41:53.177970 16546 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:53.178682 16546 heartbeater.cc:511] Master 127.13.88.254:39143 requested a full tablet report, sending...
I20260923 19:41:53.180045 16090 ts_manager.cc:194] Registered new tserver with Master: 7551835d979140fca8261b2adc3db6ee (127.13.88.195:46047)
I20260923 19:41:53.180830 16090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:48741
I20260923 19:41:53.187204 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 19:41:53.216385 16281 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:41:53.213770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56746 (local address 127.13.88.254:39143)
0923 19:41:53.214023 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:53.214030 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:53.214390 (+ 360us) server_negotiation.cc:407] Connection header received
0923 19:41:53.214541 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:53.214545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:53.214623 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:53.214713 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:53.216130 (+ 1417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56746: BlockingRecv error: recv got EOF from 127.0.0.1:56746 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 19:41:53.220084 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16151
W20260923 19:41:53.224563 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16151: Not authorized: Client connection negotiation failed: client connection to 127.13.88.193:42031: server requires authentication, but client does not have Kerberos credentials available
I20260923 19:41:53.224751 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16151
I20260923 19:41:53.240469 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16285
W20260923 19:41:53.243083 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16285: Not authorized: Client connection negotiation failed: client connection to 127.13.88.194:38611: server requires authentication, but client does not have Kerberos credentials available
I20260923 19:41:53.243307 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16285
I20260923 19:41:53.258945 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16418
W20260923 19:41:53.261623 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16418: Not authorized: Client connection negotiation failed: client connection to 127.13.88.195:46047: server requires authentication, but client does not have Kerberos credentials available
I20260923 19:41:53.261773 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16418
I20260923 19:41:53.276718 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16058
I20260923 19:41:53.277951 16120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:53.379423 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16058
2026-09-23T19:41:53Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3505 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:53 dist-test-slave-xg7f krb5kdc[16563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:53 dist-test-slave-xg7f krb5kdc[16563](info): set up 2 sockets
Sep 23 19:41:53 dist-test-slave-xg7f krb5kdc[16563](info): commencing operation
krb5kdc: starting...
W20260923 19:41:54.443468 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.000s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:54 dist-test-slave-xg7f krb5kdc[16563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:54.628017 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:34183
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:34183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:54.944214 16576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:54.944558 16576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:54.944726 16576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:54.951861 16576 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:54.952036 16576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:54.952147 16576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:54.952250 16576 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:54.952339 16576 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:54.962338 16576 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:34183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:34183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:54.963716 16576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:54.965075 16576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:54.976616 16582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:54.977145 16581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:54.977288 16584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:54.977950 16576 server_base.cc:1034] running on GCE node
I20260923 19:41:54.978856 16576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:54.980368 16576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:54.981588 16576 hybrid_clock.cc:648] HybridClock initialized: now 1790192514981528 us; error 34 us; skew 500 ppm
I20260923 19:41:54.982008 16576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:54 dist-test-slave-xg7f krb5kdc[16563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192514, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:54.985806 16576 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:41:54.987277 16576 webserver.cc:460] Webserver started at http://127.13.88.254:43157/ using document root <none> and password file <none>
I20260923 19:41:54.987952 16576 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:54.988095 16576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:54.988416 16576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:54.991364 16576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "ede4533b98984773826d81fe4ff8bf0f"
format_stamp: "Formatted at 2026-09-23 19:41:54 on dist-test-slave-xg7f"
server_key: "bedfc1d2b01dc5c479fd1d4f80433fa7"
server_key_iv: "aab17b956f7c530a4b4ee6b979288515"
server_key_version: "encryptionkey@0"
I20260923 19:41:54.992173 16576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "ede4533b98984773826d81fe4ff8bf0f"
format_stamp: "Formatted at 2026-09-23 19:41:54 on dist-test-slave-xg7f"
server_key: "bedfc1d2b01dc5c479fd1d4f80433fa7"
server_key_iv: "aab17b956f7c530a4b4ee6b979288515"
server_key_version: "encryptionkey@0"
I20260923 19:41:54.997155 16576 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:41:55.000648 16591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:55.001976 16576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:41:55.002159 16576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "ede4533b98984773826d81fe4ff8bf0f"
format_stamp: "Formatted at 2026-09-23 19:41:54 on dist-test-slave-xg7f"
server_key: "bedfc1d2b01dc5c479fd1d4f80433fa7"
server_key_iv: "aab17b956f7c530a4b4ee6b979288515"
server_key_version: "encryptionkey@0"
I20260923 19:41:55.002364 16576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:55.016258 16576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:55.020736 16576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:55.021039 16576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:55.039598 16576 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:34183
I20260923 19:41:55.039621 16642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:34183 every 8 connection(s)
I20260923 19:41:55.041047 16576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:55.044862 16643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:41:55.045727 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16576
I20260923 19:41:55.045990 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:41:55.046814 13667 external_mini_cluster.cc:1428] Setting key 94f5ebf89a37efee53d73765aa69158d
I20260923 19:41:55.058081 16643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f: Bootstrap starting.
Sep 23 19:41:55 dist-test-slave-xg7f krb5kdc[16563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192514, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:55.061452 16643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:55.062525 16643 log.cc:824] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:55.065307 16643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f: No bootstrap required, opened a new log
I20260923 19:41:55.068535 16646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:55.048825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43346 (local address 127.13.88.254:34183)
0923 19:41:55.049597 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:55.049611 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:55.049653 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:41:55.051347 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:55.051372 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:55.051753 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:55.052209 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:55.053652 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:55.054900 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:55.056213 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:55.056863 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:55.057074 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:55.061215 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:55.061223 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:55.061237 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:55.061275 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:55.064407 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:55.065165 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:55.065176 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:55.065188 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:55.065373 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:55.065794 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:55.065800 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:55.065803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:55.066340 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:55.066639 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:55.067136 (+ 497us) server_negotiation.cc:299] Negotiation successful
0923 19:41:55.067556 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":350,"threads_started":1}
I20260923 19:41:55.072261 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:41:55.073364 16643 raft_consensus.cc:348] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede4533b98984773826d81fe4ff8bf0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34183 } }
I20260923 19:41:55.073714 16643 raft_consensus.cc:374] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:55.073807 16643 raft_consensus.cc:729] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede4533b98984773826d81fe4ff8bf0f, State: Initialized, Role: FOLLOWER
I20260923 19:41:55.074447 16643 consensus_queue.cc:260] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede4533b98984773826d81fe4ff8bf0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34183 } }
I20260923 19:41:55.074674 16643 raft_consensus.cc:388] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:55.074802 16643 raft_consensus.cc:482] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:55.074970 16643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:55.077204 16643 raft_consensus.cc:504] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede4533b98984773826d81fe4ff8bf0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34183 } }
I20260923 19:41:55.077775 16643 leader_election.cc:302] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ede4533b98984773826d81fe4ff8bf0f; no voters:
I20260923 19:41:55.078469 16643 leader_election.cc:288] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:55.078527 16649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:55.080685 16643 sys_catalog.cc:564] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:55.083442 16649 raft_consensus.cc:686] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [term 1 LEADER]: Becoming Leader. State: Replica: ede4533b98984773826d81fe4ff8bf0f, State: Running, Role: LEADER
I20260923 19:41:55.084031 16649 consensus_queue.cc:237] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede4533b98984773826d81fe4ff8bf0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34183 } }
I20260923 19:41:55.086673 16651 sys_catalog.cc:455] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ede4533b98984773826d81fe4ff8bf0f. Latest consensus state: current_term: 1 leader_uuid: "ede4533b98984773826d81fe4ff8bf0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede4533b98984773826d81fe4ff8bf0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34183 } } }
I20260923 19:41:55.086694 16650 sys_catalog.cc:455] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ede4533b98984773826d81fe4ff8bf0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede4533b98984773826d81fe4ff8bf0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34183 } } }
I20260923 19:41:55.087142 16650 sys_catalog.cc:458] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:55.087183 16651 sys_catalog.cc:458] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:55.088057 16656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:55.105978 16656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:55.131605 16656 catalog_manager.cc:1347] Generated new cluster ID: e3d6e1e5ebaa48e3ad3147c81ea0db5c
I20260923 19:41:55.131738 16656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:55.146047 16656 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:55.148025 16656 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:55.155169 16646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:55.145499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43356 (local address 127.13.88.254:34183)
0923 19:41:55.145653 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:55.145660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:55.146556 (+ 896us) server_negotiation.cc:407] Connection header received
0923 19:41:55.146744 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:55.146751 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:55.146842 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:55.146972 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:55.148292 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:55.149462 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:55.151284 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:55.152015 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:55.152144 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:55.153364 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:55.153372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:55.153380 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:41:55.154273 (+ 893us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:55.154339 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:41:55.154377 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:55.154496 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:55.154644 (+ 148us) server_negotiation.cc:299] Negotiation successful
0923 19:41:55.154787 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260923 19:41:55.157595 16656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ede4533b98984773826d81fe4ff8bf0f: Generated new TSK 0
I20260923 19:41:55.158411 16656 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:41:55.167230 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16576
I20260923 19:41:55.168430 16638 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:55.256695 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16576
2026-09-23T19:41:55Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1870 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:55 dist-test-slave-xg7f krb5kdc[16677](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:55 dist-test-slave-xg7f krb5kdc[16677](info): set up 2 sockets
Sep 23 19:41:55 dist-test-slave-xg7f krb5kdc[16677](info): commencing operation
krb5kdc: starting...
W20260923 19:41:56.315325 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.003s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:56 dist-test-slave-xg7f krb5kdc[16677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:56.490145 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42749
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:42749
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:56.797576 16690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:56.797919 16690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:56.798091 16690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:56.805160 16690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:41:56.805298 16690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:56.805405 16690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:56.805512 16690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:41:56.805599 16690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:41:56.815238 16690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:42749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:56.816555 16690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:56.817862 16690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:56.829037 16695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:56.828994 16696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:56.828969 16698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:56.829991 16690 server_base.cc:1034] running on GCE node
I20260923 19:41:56.830711 16690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:56.831974 16690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:56.833166 16690 hybrid_clock.cc:648] HybridClock initialized: now 1790192516833128 us; error 33 us; skew 500 ppm
I20260923 19:41:56.833480 16690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:56 dist-test-slave-xg7f krb5kdc[16677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192516, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:56.839658 16690 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:41:56.840946 16690 webserver.cc:460] Webserver started at http://127.13.88.254:41177/ using document root <none> and password file <none>
I20260923 19:41:56.841571 16690 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:56.841709 16690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:56.841996 16690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:56.844805 16690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "13899f1d3fde4b2694f158c365d4b6e1"
format_stamp: "Formatted at 2026-09-23 19:41:56 on dist-test-slave-xg7f"
server_key: "39689732fdfb6bb765d30fdad8dc9887"
server_key_iv: "59b077bea2725f8b9e7cc3851c21983a"
server_key_version: "encryptionkey@0"
I20260923 19:41:56.845535 16690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "13899f1d3fde4b2694f158c365d4b6e1"
format_stamp: "Formatted at 2026-09-23 19:41:56 on dist-test-slave-xg7f"
server_key: "39689732fdfb6bb765d30fdad8dc9887"
server_key_iv: "59b077bea2725f8b9e7cc3851c21983a"
server_key_version: "encryptionkey@0"
I20260923 19:41:56.850448 16690 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 19:41:56.853681 16705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:56.854926 16690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:41:56.855149 16690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "13899f1d3fde4b2694f158c365d4b6e1"
format_stamp: "Formatted at 2026-09-23 19:41:56 on dist-test-slave-xg7f"
server_key: "39689732fdfb6bb765d30fdad8dc9887"
server_key_iv: "59b077bea2725f8b9e7cc3851c21983a"
server_key_version: "encryptionkey@0"
I20260923 19:41:56.855345 16690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:56.871454 16690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:56.875638 16690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:56.875932 16690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:56.893270 16690 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:42749
I20260923 19:41:56.893302 16756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:42749 every 8 connection(s)
I20260923 19:41:56.894500 16690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:41:56.895586 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16690
I20260923 19:41:56.895784 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:41:56.896427 13667 external_mini_cluster.cc:1428] Setting key 1342bd18d7d1419d4ff925f0f2f6b2ad
I20260923 19:41:56.898553 16757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:41:56 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192516, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:56.911401 16757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1: Bootstrap starting.
I20260923 19:41:56.914394 16757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1: Neither blocks nor log segments found. Creating new log.
I20260923 19:41:56.915457 16757 log.cc:824] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1: Log is configured to *not* fsync() on all Append() calls
I20260923 19:41:56.918481 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:56.898284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55476 (local address 127.13.88.254:42749)
0923 19:41:56.899069 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:56.899080 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:56.899166 (+ 86us) server_negotiation.cc:407] Connection header received
0923 19:41:56.900723 (+ 1557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:56.900743 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:56.901106 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:56.901405 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:56.903013 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:56.904316 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:56.906148 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:56.906771 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:56.906895 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:56.911402 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:56.911410 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:56.911423 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:56.911463 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:56.914415 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:56.915069 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:56.915085 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:56.915091 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:56.915309 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:56.915696 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:56.915701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:56.915705 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:56.916426 (+ 721us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:56.916741 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:56.917100 (+ 359us) server_negotiation.cc:299] Negotiation successful
0923 19:41:56.917478 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":383,"threads_started":1}
I20260923 19:41:56.918462 16757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1: No bootstrap required, opened a new log
I20260923 19:41:56.925985 16757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13899f1d3fde4b2694f158c365d4b6e1" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42749 } }
I20260923 19:41:56.926337 16757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:41:56.926445 16757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13899f1d3fde4b2694f158c365d4b6e1, State: Initialized, Role: FOLLOWER
I20260923 19:41:56.927011 16757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13899f1d3fde4b2694f158c365d4b6e1" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42749 } }
I20260923 19:41:56.927306 16757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:41:56.927457 16757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:41:56.927621 16757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:41:56.929553 16757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13899f1d3fde4b2694f158c365d4b6e1" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42749 } }
I20260923 19:41:56.930022 16757 leader_election.cc:302] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13899f1d3fde4b2694f158c365d4b6e1; no voters:
I20260923 19:41:56.930642 16757 leader_election.cc:288] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:41:56.930750 16762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:41:56.931443 16762 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [term 1 LEADER]: Becoming Leader. State: Replica: 13899f1d3fde4b2694f158c365d4b6e1, State: Running, Role: LEADER
I20260923 19:41:56.931958 16762 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13899f1d3fde4b2694f158c365d4b6e1" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42749 } }
I20260923 19:41:56.932597 16757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:41:56.935006 16763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13899f1d3fde4b2694f158c365d4b6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13899f1d3fde4b2694f158c365d4b6e1" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42749 } } }
I20260923 19:41:56.935117 16764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13899f1d3fde4b2694f158c365d4b6e1. Latest consensus state: current_term: 1 leader_uuid: "13899f1d3fde4b2694f158c365d4b6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13899f1d3fde4b2694f158c365d4b6e1" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42749 } } }
I20260923 19:41:56.935472 16763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:56.935503 16764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1 [sys.catalog]: This master's current role is: LEADER
I20260923 19:41:56.936290 16770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:41:56.942525 16770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:41:56.951059 16770 catalog_manager.cc:1347] Generated new cluster ID: aea297d030c54318b77c03cbea47b2f3
I20260923 19:41:56.951185 16770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:41:56.958912 16770 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:41:56.960400 16770 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:41:56.971738 16770 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13899f1d3fde4b2694f158c365d4b6e1: Generated new TSK 0
I20260923 19:41:56.972502 16770 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:41:57.020262 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42749
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:57.334354 16783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:57.334640 16783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:57.334830 16783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:57.342345 16783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:57.342454 16783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:57.342654 16783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:41:57.352285 16783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42749
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:57.353725 16783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:57.355065 16783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:57.368256 16789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:57.368283 16791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:57.368489 16788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:57.368903 16783 server_base.cc:1034] running on GCE node
I20260923 19:41:57.369524 16783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:57.370414 16783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:57.371629 16783 hybrid_clock.cc:648] HybridClock initialized: now 1790192517371583 us; error 60 us; skew 500 ppm
I20260923 19:41:57.371953 16783 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:57 dist-test-slave-xg7f krb5kdc[16677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192517, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:57.374971 16783 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:41:57.376442 16783 webserver.cc:460] Webserver started at http://127.13.88.193:38305/ using document root <none> and password file <none>
I20260923 19:41:57.377104 16783 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:57.377243 16783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:57.377528 16783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:57.380496 16783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "b5b66c3161cf4929ba404f4c40d59d62"
format_stamp: "Formatted at 2026-09-23 19:41:57 on dist-test-slave-xg7f"
server_key: "6b4f3607026620a5ccfe5e140e3cbc2c"
server_key_iv: "a5781ef1f85d2159d1ad9a6f42e9e0d3"
server_key_version: "encryptionkey@0"
I20260923 19:41:57.381235 16783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "b5b66c3161cf4929ba404f4c40d59d62"
format_stamp: "Formatted at 2026-09-23 19:41:57 on dist-test-slave-xg7f"
server_key: "6b4f3607026620a5ccfe5e140e3cbc2c"
server_key_iv: "a5781ef1f85d2159d1ad9a6f42e9e0d3"
server_key_version: "encryptionkey@0"
I20260923 19:41:57.385993 16783 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260923 19:41:57.389163 16798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:57.390394 16783 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 19:41:57.390552 16783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "b5b66c3161cf4929ba404f4c40d59d62"
format_stamp: "Formatted at 2026-09-23 19:41:57 on dist-test-slave-xg7f"
server_key: "6b4f3607026620a5ccfe5e140e3cbc2c"
server_key_iv: "a5781ef1f85d2159d1ad9a6f42e9e0d3"
server_key_version: "encryptionkey@0"
I20260923 19:41:57.390723 16783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:57.421928 16783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:57.425511 16783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:57.425793 16783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:57.426721 16783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:57.427983 16783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:57.428081 16783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:57.428236 16783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:57.428308 16783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:57.458815 16783 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:34059
I20260923 19:41:57.458835 16910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:34059 every 8 connection(s)
I20260923 19:41:57.460345 16783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:41:57.467548 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16783
I20260923 19:41:57.467758 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:41:57.468533 13667 external_mini_cluster.cc:1428] Setting key 41651c2d284c0a8fe6d4743e24169606
Sep 23 19:41:57 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192517, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:57.481580 16913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:57.462842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:51389 (local address 127.13.88.254:42749)
0923 19:41:57.463320 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:57.463325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:57.464281 (+ 956us) server_negotiation.cc:407] Connection header received
0923 19:41:57.465948 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:57.465953 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:57.466019 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:57.466114 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:57.467608 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.468764 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.470485 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.471136 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.471290 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:57.475220 (+ 3930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:57.475225 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:57.475228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:57.475260 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:57.478446 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:57.479148 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:57.479156 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:57.479163 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:57.479312 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:57.479694 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:57.479702 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:57.479709 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:57.480077 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:57.480217 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:57.480843 (+ 626us) server_negotiation.cc:299] Negotiation successful
0923 19:41:57.481084 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":276,"threads_started":1}
I20260923 19:41:57.482211 16914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:57.463478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42749 (local address 127.13.88.193:51389)
0923 19:41:57.464121 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:57.464158 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:57.465705 (+ 1547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:57.466317 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:57.466325 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:57.466796 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:57.467438 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:57.467455 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.468903 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.468907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:57.470361 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:57.470372 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.471373 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.471383 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:57.471619 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:57.472297 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:57.472323 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:57.474965 (+ 2642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:57.478580 (+ 3615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:57.478587 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:57.478598 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:57.479009 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:57.479423 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:57.479426 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:57.479429 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:57.479591 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:57.480196 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:57.480201 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:57.480502 (+ 301us) client_negotiation.cc:769] Sending connection context
0923 19:41:57.480723 (+ 221us) client_negotiation.cc:240] Negotiation successful
0923 19:41:57.481095 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":257,"threads_started":1}
I20260923 19:41:57.483783 16911 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42749
I20260923 19:41:57.484095 16911 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:57.484810 16911 heartbeater.cc:511] Master 127.13.88.254:42749 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:41:57.486820 16722 ts_manager.cc:194] Registered new tserver with Master: b5b66c3161cf4929ba404f4c40d59d62 (127.13.88.193:34059)
I20260923 19:41:57.488374 16722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:51389
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:41:57.509567 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42749
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:57.820349 16917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:57.820657 16917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:57.820815 16917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:57.827718 16917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:57.827853 16917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:57.828032 16917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:41:57.837020 16917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42749
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:57.838251 16917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:57.839587 16917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:57.851598 16922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:57.851568 16925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:57.851661 16923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:57.852865 16917 server_base.cc:1034] running on GCE node
I20260923 19:41:57.853515 16917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:57.854403 16917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:57.855628 16917 hybrid_clock.cc:648] HybridClock initialized: now 1790192517855575 us; error 64 us; skew 500 ppm
I20260923 19:41:57.855943 16917 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:57 dist-test-slave-xg7f krb5kdc[16677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192517, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:57.859184 16917 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:41:57.860654 16917 webserver.cc:460] Webserver started at http://127.13.88.194:36097/ using document root <none> and password file <none>
I20260923 19:41:57.861289 16917 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:57.861387 16917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:57.861644 16917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:57.864523 16917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "7552c3b7ded94536b915a871a53e612c"
format_stamp: "Formatted at 2026-09-23 19:41:57 on dist-test-slave-xg7f"
server_key: "5f750ab552381f5163a6315eb2daebf9"
server_key_iv: "680aefb11ebbabdd53ae9f19c770a719"
server_key_version: "encryptionkey@0"
I20260923 19:41:57.865254 16917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "7552c3b7ded94536b915a871a53e612c"
format_stamp: "Formatted at 2026-09-23 19:41:57 on dist-test-slave-xg7f"
server_key: "5f750ab552381f5163a6315eb2daebf9"
server_key_iv: "680aefb11ebbabdd53ae9f19c770a719"
server_key_version: "encryptionkey@0"
I20260923 19:41:57.870314 16917 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:41:57.873612 16932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:57.874888 16917 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:41:57.875046 16917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "7552c3b7ded94536b915a871a53e612c"
format_stamp: "Formatted at 2026-09-23 19:41:57 on dist-test-slave-xg7f"
server_key: "5f750ab552381f5163a6315eb2daebf9"
server_key_iv: "680aefb11ebbabdd53ae9f19c770a719"
server_key_version: "encryptionkey@0"
I20260923 19:41:57.875293 16917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:57.897737 16917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:57.901842 16917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:57.902151 16917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:57.903159 16917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:57.904551 16917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:57.904673 16917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:57.904814 16917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:57.904884 16917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:57.937381 16917 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:43071
I20260923 19:41:57.937424 17044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:43071 every 8 connection(s)
I20260923 19:41:57.938787 16917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:41:57.946926 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 16917
I20260923 19:41:57.947115 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:41:57.947602 13667 external_mini_cluster.cc:1428] Setting key 755f209f7812357b498c1b7498f0c1d3
Sep 23 19:41:57 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192517, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:57.958345 16913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:57.941408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:49851 (local address 127.13.88.254:42749)
0923 19:41:57.941578 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:57.941583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:57.942626 (+ 1043us) server_negotiation.cc:407] Connection header received
0923 19:41:57.944470 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:57.944485 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:57.944577 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:57.944684 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:57.946095 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.946939 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.948576 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.949018 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.949150 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:57.952515 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:57.952520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:57.952523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:57.952554 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:57.955171 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:57.956076 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:57.956080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:57.956083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:57.956207 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:57.956655 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:57.956658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:57.956660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:57.956917 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:57.957026 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:57.957842 (+ 816us) server_negotiation.cc:299] Negotiation successful
0923 19:41:57.958009 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:41:57.959746 17047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:57.941801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42749 (local address 127.13.88.194:49851)
0923 19:41:57.942482 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:57.942518 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:57.944197 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:57.944911 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:57.944920 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:57.945397 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:57.945917 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:57.945937 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.947083 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.947095 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:57.948434 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:57.948446 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:57.949231 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:57.949238 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:57.949461 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:57.950120 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:57.950142 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:57.952293 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:57.955298 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:57.955309 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:57.955329 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:57.955941 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:57.956314 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:57.956321 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:57.956328 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:57.956551 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:57.957041 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:57.957051 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:57.957466 (+ 415us) client_negotiation.cc:769] Sending connection context
0923 19:41:57.957760 (+ 294us) client_negotiation.cc:240] Negotiation successful
0923 19:41:57.958322 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":262,"threads_started":1}
I20260923 19:41:57.961232 17045 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42749
I20260923 19:41:57.961542 17045 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:57.962419 17045 heartbeater.cc:511] Master 127.13.88.254:42749 requested a full tablet report, sending...
I20260923 19:41:57.964022 16722 ts_manager.cc:194] Registered new tserver with Master: 7552c3b7ded94536b915a871a53e612c (127.13.88.194:43071)
I20260923 19:41:57.964816 16722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:49851
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:41:57.989603 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42749
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:41:58.300163 17050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:41:58.300447 17050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:41:58.300639 17050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:41:58.307955 17050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:41:58.308076 17050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:41:58.308261 17050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:41:58.317728 17050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42749
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:41:58.319037 17050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:41:58.320372 17050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:41:58.332953 17055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:58.332917 17056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:41:58.332990 17058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:41:58.334060 17050 server_base.cc:1034] running on GCE node
I20260923 19:41:58.334611 17050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:41:58.335528 17050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:41:58.336745 17050 hybrid_clock.cc:648] HybridClock initialized: now 1790192518336693 us; error 47 us; skew 500 ppm
I20260923 19:41:58.337050 17050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[16677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192518, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:41:58.340152 17050 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:41:58.341466 17050 webserver.cc:460] Webserver started at http://127.13.88.195:34109/ using document root <none> and password file <none>
I20260923 19:41:58.342099 17050 fs_manager.cc:359] Metadata directory not provided
I20260923 19:41:58.342248 17050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:41:58.342555 17050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:41:58.345407 17050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "592f7ff8be334b74a69d6ab6d720b01c"
format_stamp: "Formatted at 2026-09-23 19:41:58 on dist-test-slave-xg7f"
server_key: "1f5ef6652d965a414157155c1194ae41"
server_key_iv: "f7bb6eaec601c786393645febee7fc92"
server_key_version: "encryptionkey@0"
I20260923 19:41:58.346153 17050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "592f7ff8be334b74a69d6ab6d720b01c"
format_stamp: "Formatted at 2026-09-23 19:41:58 on dist-test-slave-xg7f"
server_key: "1f5ef6652d965a414157155c1194ae41"
server_key_iv: "f7bb6eaec601c786393645febee7fc92"
server_key_version: "encryptionkey@0"
I20260923 19:41:58.351024 17050 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260923 19:41:58.354334 17065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:58.355611 17050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:41:58.355782 17050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "592f7ff8be334b74a69d6ab6d720b01c"
format_stamp: "Formatted at 2026-09-23 19:41:58 on dist-test-slave-xg7f"
server_key: "1f5ef6652d965a414157155c1194ae41"
server_key_iv: "f7bb6eaec601c786393645febee7fc92"
server_key_version: "encryptionkey@0"
I20260923 19:41:58.355989 17050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:41:58.381203 17050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:41:58.384907 17050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:41:58.385198 17050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:41:58.386111 17050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:41:58.387444 17050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:41:58.387547 17050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:58.387693 17050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:41:58.387766 17050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:41:58.419006 17050 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:38059
I20260923 19:41:58.419054 17177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:38059 every 8 connection(s)
I20260923 19:41:58.420253 17050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:41:58.427505 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17050
I20260923 19:41:58.427670 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:41:58.428134 13667 external_mini_cluster.cc:1428] Setting key 3574dc4f07bc706b6b7d3f763bbe846b
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192518, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:58.439013 16913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:58.422551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:45625 (local address 127.13.88.254:42749)
0923 19:41:58.422714 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:58.422718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:58.423894 (+ 1176us) server_negotiation.cc:407] Connection header received
0923 19:41:58.425639 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:58.425645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:58.425733 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:58.425841 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:58.427340 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.428200 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.429988 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.430638 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.430770 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:58.434102 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:58.434107 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:58.434110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:58.434140 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:58.436512 (+ 2372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.437126 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.437129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.437131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.437235 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.437588 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.437591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.437593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.437829 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:58.437930 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:58.438567 (+ 637us) server_negotiation.cc:299] Negotiation successful
0923 19:41:58.438729 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:41:58.439944 17180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:58.423045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42749 (local address 127.13.88.195:45625)
0923 19:41:58.423741 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0923 19:41:58.423781 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:41:58.425378 (+ 1597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:41:58.426057 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:41:58.426065 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:41:58.426534 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:41:58.427163 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:58.427191 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.428357 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.428362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:58.429845 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:41:58.429865 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.430864 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.430870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:41:58.431056 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:58.431685 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:41:58.431705 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:41:58.433889 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:41:58.436627 (+ 2738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:58.436633 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:58.436644 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:58.437025 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:58.437316 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:41:58.437319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:41:58.437322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:41:58.437488 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:41:58.437921 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:41:58.437926 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:41:58.438274 (+ 348us) client_negotiation.cc:769] Sending connection context
0923 19:41:58.438494 (+ 220us) client_negotiation.cc:240] Negotiation successful
0923 19:41:58.438870 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":255,"threads_started":1}
I20260923 19:41:58.441231 17178 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42749
I20260923 19:41:58.441561 17178 heartbeater.cc:464] Registering TS with master...
I20260923 19:41:58.442431 17178 heartbeater.cc:511] Master 127.13.88.254:42749 requested a full tablet report, sending...
I20260923 19:41:58.444041 16722 ts_manager.cc:194] Registered new tserver with Master: 592f7ff8be334b74a69d6ab6d720b01c (127.13.88.195:38059)
I20260923 19:41:58.444949 16722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:45625
I20260923 19:41:58.455305 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[16677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192518, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
I20260923 19:41:58.491349 16911 heartbeater.cc:503] Master 127.13.88.254:42749 was elected leader, sending a full tablet report...
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192518, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:41:58.501259 16913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:58.487885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55488 (local address 127.13.88.254:42749)
0923 19:41:58.488040 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:58.488044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:58.488488 (+ 444us) server_negotiation.cc:407] Connection header received
0923 19:41:58.488638 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:58.488641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:58.488701 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:58.488788 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:58.490055 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.490850 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.492358 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.492772 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.492905 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:58.496477 (+ 3572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:58.496482 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:58.496485 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:58.496516 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:58.498717 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.499378 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.499385 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.499389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.499520 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.499913 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.499917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.499922 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.500216 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:58.500459 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:58.500738 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 19:41:58.500936 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260923 19:41:58.501715 16722 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55488
I20260923 19:41:58.503127 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16783
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192518, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:41:58.518107 17189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:58.504260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52564 (local address 127.13.88.193:34059)
0923 19:41:58.504884 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:58.504891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:58.504911 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:41:58.504960 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:58.504967 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:58.505178 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:58.505333 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:58.506439 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.507468 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.508643 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.509170 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.509302 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:58.512892 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:58.512902 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:58.512914 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:58.512942 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:58.515576 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.516176 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.516182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.516184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.516288 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.516662 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.516668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.516671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.516978 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:58.517260 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:58.517541 (+ 281us) server_negotiation.cc:299] Negotiation successful
0923 19:41:58.517772 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":336,"threads_started":1}
W20260923 19:41:58.519433 16906 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52564
W20260923 19:41:58.520377 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16783: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:58.520529 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16783
I20260923 19:41:58.535284 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16917
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192518, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:41:58.550351 17190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:58.536047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58234 (local address 127.13.88.194:43071)
0923 19:41:58.536574 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:58.536580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:58.536604 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:41:58.536657 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:58.536663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:58.536853 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:58.536970 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:58.538099 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.539204 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.540398 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.540937 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.541092 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:58.544978 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:58.544988 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:58.545002 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:58.545039 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:58.547700 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.548329 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.548337 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.548339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.548458 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.548809 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.548816 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.548819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.549147 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:58.549448 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:58.549743 (+ 295us) server_negotiation.cc:299] Negotiation successful
0923 19:41:58.550018 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":264,"threads_started":1}
W20260923 19:41:58.551604 17040 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58234
W20260923 19:41:58.552670 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16917: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:58.552803 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16917
I20260923 19:41:58.568413 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17050
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[16677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192518, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:41:58.584278 17191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:41:58.569413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49624 (local address 127.13.88.195:38059)
0923 19:41:58.570081 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0923 19:41:58.570088 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:41:58.570115 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:41:58.570173 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:41:58.570179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:41:58.570386 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:41:58.570523 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:41:58.571850 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.572849 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.574010 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:41:58.574535 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:41:58.574651 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:41:58.578591 (+ 3940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:41:58.578600 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:41:58.578614 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:41:58.578644 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:41:58.581649 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.582361 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.582369 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.582371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.582494 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:41:58.582787 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:41:58.582789 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:41:58.582791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:41:58.583197 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:41:58.583421 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0923 19:41:58.583669 (+ 248us) server_negotiation.cc:299] Negotiation successful
0923 19:41:58.583860 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":344,"threads_started":1}
W20260923 19:41:58.585642 17173 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49624
W20260923 19:41:58.586750 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17050: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:41:58.586958 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17050
I20260923 19:41:58.601940 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 16690
I20260923 19:41:58.603231 16752 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:41:58.704308 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 16690
2026-09-23T19:41:58Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3453 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[17195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[17195](info): set up 2 sockets
Sep 23 19:41:58 dist-test-slave-xg7f krb5kdc[17195](info): commencing operation
krb5kdc: starting...
W20260923 19:41:59.787459 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:41:59 dist-test-slave-xg7f krb5kdc[17195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:41:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:41:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:41:59.964597 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38229
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:38229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:00.279217 17208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:00.279568 17208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:00.279721 17208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:00.286859 17208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:00.287032 17208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:00.287170 17208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:00.287278 17208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:00.287353 17208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:00.297500 17208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:38229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:00.298862 17208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:00.300225 17208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:00.315657 17213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:00.315764 17214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:00.315783 17216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:00.316918 17208 server_base.cc:1034] running on GCE node
I20260923 19:42:00.317680 17208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:00.319173 17208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:00.320401 17208 hybrid_clock.cc:648] HybridClock initialized: now 1790192520320364 us; error 45 us; skew 500 ppm
I20260923 19:42:00.320756 17208 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:00 dist-test-slave-xg7f krb5kdc[17195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192520, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:00.323845 17208 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:42:00.325210 17208 webserver.cc:460] Webserver started at http://127.13.88.254:40911/ using document root <none> and password file <none>
I20260923 19:42:00.325860 17208 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:00.325953 17208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:00.326207 17208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:00.329129 17208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "e7b35f14fd764906919266a80ee07222"
format_stamp: "Formatted at 2026-09-23 19:42:00 on dist-test-slave-xg7f"
server_key: "61b4cbbffc3dad9f7a1ee1464eacc03e"
server_key_iv: "9c2112274ff958f619e550dad9ca8230"
server_key_version: "encryptionkey@0"
I20260923 19:42:00.329850 17208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "e7b35f14fd764906919266a80ee07222"
format_stamp: "Formatted at 2026-09-23 19:42:00 on dist-test-slave-xg7f"
server_key: "61b4cbbffc3dad9f7a1ee1464eacc03e"
server_key_iv: "9c2112274ff958f619e550dad9ca8230"
server_key_version: "encryptionkey@0"
I20260923 19:42:00.334842 17208 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:42:00.338034 17223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:00.339365 17208 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:42:00.339501 17208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "e7b35f14fd764906919266a80ee07222"
format_stamp: "Formatted at 2026-09-23 19:42:00 on dist-test-slave-xg7f"
server_key: "61b4cbbffc3dad9f7a1ee1464eacc03e"
server_key_iv: "9c2112274ff958f619e550dad9ca8230"
server_key_version: "encryptionkey@0"
I20260923 19:42:00.339649 17208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:00.354864 17208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:00.359251 17208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:00.359490 17208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:00.377182 17208 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:38229
I20260923 19:42:00.377188 17274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:38229 every 8 connection(s)
I20260923 19:42:00.378543 17208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:00.381990 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17208
I20260923 19:42:00.382203 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:00.382272 17275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:00.382840 13667 external_mini_cluster.cc:1428] Setting key 4b9ee195d61787b55034cb6c6486ea14
I20260923 19:42:00.396306 17275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222: Bootstrap starting.
Sep 23 19:42:00 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:00.399932 17275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:00.400967 17275 log.cc:824] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:00.403654 17275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222: No bootstrap required, opened a new log
I20260923 19:42:00.405334 17278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:00.384813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58758 (local address 127.13.88.254:38229)
0923 19:42:00.385699 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:00.385719 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:00.385768 (+ 49us) server_negotiation.cc:407] Connection header received
0923 19:42:00.387633 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:00.387664 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:00.388170 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:00.388613 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:00.389868 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:00.391756 (+ 1888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:00.392968 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:00.394071 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:00.394253 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:00.398081 (+ 3828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:00.398091 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:00.398109 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:00.398166 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:00.401487 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:00.402131 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:00.402145 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:00.402150 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:00.402300 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:00.402667 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:00.402673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:00.402677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:00.403217 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:00.403545 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:00.403934 (+ 389us) server_negotiation.cc:299] Negotiation successful
0923 19:42:00.404356 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":356,"threads_started":1}
I20260923 19:42:00.411300 17275 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b35f14fd764906919266a80ee07222" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38229 } }
I20260923 19:42:00.411697 17275 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:00.411810 17275 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7b35f14fd764906919266a80ee07222, State: Initialized, Role: FOLLOWER
I20260923 19:42:00.412431 17275 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b35f14fd764906919266a80ee07222" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38229 } }
I20260923 19:42:00.412714 17275 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:00.412850 17275 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:00.413048 17275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:00.415340 17275 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b35f14fd764906919266a80ee07222" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38229 } }
I20260923 19:42:00.415751 17275 leader_election.cc:302] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7b35f14fd764906919266a80ee07222; no voters:
I20260923 19:42:00.416261 17275 leader_election.cc:288] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:00.416366 17280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:00.417071 17280 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [term 1 LEADER]: Becoming Leader. State: Replica: e7b35f14fd764906919266a80ee07222, State: Running, Role: LEADER
I20260923 19:42:00.417590 17280 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b35f14fd764906919266a80ee07222" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38229 } }
I20260923 19:42:00.418359 17275 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:00.420452 17281 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7b35f14fd764906919266a80ee07222" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b35f14fd764906919266a80ee07222" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38229 } } }
I20260923 19:42:00.420897 17281 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:00.420459 17282 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7b35f14fd764906919266a80ee07222. Latest consensus state: current_term: 1 leader_uuid: "e7b35f14fd764906919266a80ee07222" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7b35f14fd764906919266a80ee07222" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38229 } } }
I20260923 19:42:00.422813 17282 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:00.423264 17287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:00.428692 17287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:00.436746 17287 catalog_manager.cc:1347] Generated new cluster ID: 697f289e25894015a6c6e24ee642278d
I20260923 19:42:00.436892 17287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:00.449918 17287 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:00.451473 17287 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:00.461354 17287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7b35f14fd764906919266a80ee07222: Generated new TSK 0
I20260923 19:42:00.462106 17287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:42:00.502759 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38229
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:00.818512 17301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:00.818876 17301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:00.819005 17301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:00.826182 17301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:00.826282 17301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:00.826387 17301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:00.840184 17301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:00.841439 17301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:00.842831 17301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:00.855827 17307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:00.855921 17309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:00.855950 17306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:00.856956 17301 server_base.cc:1034] running on GCE node
I20260923 19:42:00.857540 17301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:00.858438 17301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:00.859654 17301 hybrid_clock.cc:648] HybridClock initialized: now 1790192520859554 us; error 110 us; skew 500 ppm
I20260923 19:42:00.859949 17301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:00 dist-test-slave-xg7f krb5kdc[17195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192520, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:00.863023 17301 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:42:00.864385 17301 webserver.cc:460] Webserver started at http://127.13.88.193:36735/ using document root <none> and password file <none>
I20260923 19:42:00.865078 17301 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:00.865176 17301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:00.865499 17301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:00.868321 17301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "f23901b475ac435c93378e700cca3939"
format_stamp: "Formatted at 2026-09-23 19:42:00 on dist-test-slave-xg7f"
server_key: "30dab1d865f2dc216f1d21954c7401aa"
server_key_iv: "44f712eee30b6a420ebd01819e0f3577"
server_key_version: "encryptionkey@0"
I20260923 19:42:00.869310 17301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "f23901b475ac435c93378e700cca3939"
format_stamp: "Formatted at 2026-09-23 19:42:00 on dist-test-slave-xg7f"
server_key: "30dab1d865f2dc216f1d21954c7401aa"
server_key_iv: "44f712eee30b6a420ebd01819e0f3577"
server_key_version: "encryptionkey@0"
I20260923 19:42:00.874707 17301 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:42:00.878031 17316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:00.879308 17301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:00.879465 17301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "f23901b475ac435c93378e700cca3939"
format_stamp: "Formatted at 2026-09-23 19:42:00 on dist-test-slave-xg7f"
server_key: "30dab1d865f2dc216f1d21954c7401aa"
server_key_iv: "44f712eee30b6a420ebd01819e0f3577"
server_key_version: "encryptionkey@0"
I20260923 19:42:00.879658 17301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:00.905063 17301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:00.909405 17301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:00.909685 17301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:00.910640 17301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:00.912050 17301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:00.912119 17301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:00.912282 17301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:00.912339 17301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:00.945215 17301 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:33153
I20260923 19:42:00.945262 17428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:33153 every 8 connection(s)
I20260923 19:42:00.946519 17301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:00.950652 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17301
I20260923 19:42:00.950881 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:00.951721 13667 external_mini_cluster.cc:1428] Setting key 1af09bf24fd8f60b45370bbf665e2b80
Sep 23 19:42:00 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192520, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:00.969445 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:00.948955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:42267 (local address 127.13.88.254:38229)
0923 19:42:00.949387 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:00.949394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:00.950495 (+ 1101us) server_negotiation.cc:407] Connection header received
0923 19:42:00.952990 (+ 2495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:00.952995 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:00.953069 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:00.953187 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:00.955178 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:00.955873 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:00.958408 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:00.958853 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:00.959021 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:00.962749 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:00.962758 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:00.962766 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:00.962810 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:00.966257 (+ 3447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:00.966987 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:00.966993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:00.966998 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:00.967170 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:00.967571 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:00.967576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:00.967580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:00.967959 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:00.968134 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:00.968757 (+ 623us) server_negotiation.cc:299] Negotiation successful
0923 19:42:00.969018 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":196,"threads_started":1}
I20260923 19:42:00.970098 17432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:00.949553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38229 (local address 127.13.88.193:42267)
0923 19:42:00.950294 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:00.950357 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:00.952701 (+ 2344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:00.953363 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:00.953371 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:00.954136 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:00.954941 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:00.954980 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:00.956034 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:00.956042 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:00.958192 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:00.958208 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:00.959119 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:00.959126 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:00.959393 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:00.960150 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:00.960183 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:00.962529 (+ 2346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:00.966456 (+ 3927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:00.966462 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:00.966474 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:00.966867 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:00.967297 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:00.967300 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:00.967302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:00.967466 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:00.968112 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:00.968117 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:00.968406 (+ 289us) client_negotiation.cc:769] Sending connection context
0923 19:42:00.968625 (+ 219us) client_negotiation.cc:240] Negotiation successful
0923 19:42:00.969012 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":252,"threads_started":1}
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:42:00.971661 17429 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38229
I20260923 19:42:00.971990 17429 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:00.972656 17429 heartbeater.cc:511] Master 127.13.88.254:38229 requested a full tablet report, sending...
I20260923 19:42:00.974542 17240 ts_manager.cc:194] Registered new tserver with Master: f23901b475ac435c93378e700cca3939 (127.13.88.193:33153)
I20260923 19:42:00.975966 17240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:42267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:42:01.006721 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38229
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:01.324601 17435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:01.324870 17435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:01.324968 17435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:01.332150 17435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:01.332255 17435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:01.332365 17435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:01.342598 17435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:01.343928 17435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:01.345253 17435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:01.358072 17440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:01.358031 17443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:01.358119 17441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:01.358897 17435 server_base.cc:1034] running on GCE node
I20260923 19:42:01.359531 17435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:01.360473 17435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:01.361712 17435 hybrid_clock.cc:648] HybridClock initialized: now 1790192521361662 us; error 34 us; skew 500 ppm
I20260923 19:42:01.362039 17435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:01 dist-test-slave-xg7f krb5kdc[17195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:01.365084 17435 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:42:01.366415 17435 webserver.cc:460] Webserver started at http://127.13.88.194:33261/ using document root <none> and password file <none>
I20260923 19:42:01.367089 17435 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:01.367301 17435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:01.367611 17435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:01.370330 17435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "f7b1da9745144a50a34b091ae10bf1de"
format_stamp: "Formatted at 2026-09-23 19:42:01 on dist-test-slave-xg7f"
server_key: "f270a8cfe07cde60d322ff1766c296f1"
server_key_iv: "879ee6c1ece61cb5631e69bc4a38b27b"
server_key_version: "encryptionkey@0"
I20260923 19:42:01.371178 17435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "f7b1da9745144a50a34b091ae10bf1de"
format_stamp: "Formatted at 2026-09-23 19:42:01 on dist-test-slave-xg7f"
server_key: "f270a8cfe07cde60d322ff1766c296f1"
server_key_iv: "879ee6c1ece61cb5631e69bc4a38b27b"
server_key_version: "encryptionkey@0"
I20260923 19:42:01.376075 17435 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260923 19:42:01.379618 17450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:01.381009 17435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:42:01.381167 17435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "f7b1da9745144a50a34b091ae10bf1de"
format_stamp: "Formatted at 2026-09-23 19:42:01 on dist-test-slave-xg7f"
server_key: "f270a8cfe07cde60d322ff1766c296f1"
server_key_iv: "879ee6c1ece61cb5631e69bc4a38b27b"
server_key_version: "encryptionkey@0"
I20260923 19:42:01.381351 17435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:01.400678 17435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:01.404376 17435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:01.404655 17435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:01.405571 17435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:01.406785 17435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:01.406852 17435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:01.407027 17435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:01.407074 17435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:01.439716 17435 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:37823
I20260923 19:42:01.439793 17562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:37823 every 8 connection(s)
I20260923 19:42:01.441045 17435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:01.444574 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17435
I20260923 19:42:01.444780 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:01.445307 13667 external_mini_cluster.cc:1428] Setting key d85a82e5ca56f44af908d53d4ce8bcdb
Sep 23 19:42:01 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:01.462860 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:01.443621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:54689 (local address 127.13.88.254:38229)
0923 19:42:01.443790 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:01.443794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:01.445238 (+ 1444us) server_negotiation.cc:407] Connection header received
0923 19:42:01.447452 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:01.447456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:01.447517 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:01.447593 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:01.449604 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.450292 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.452752 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.453148 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.453246 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:01.457086 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:01.457091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:01.457094 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:01.457123 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:01.459611 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:01.460540 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:01.460544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:01.460547 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:01.460661 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:01.461133 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:01.461136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:01.461138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:01.461378 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:01.461544 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:01.462470 (+ 926us) server_negotiation.cc:299] Negotiation successful
0923 19:42:01.462622 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:42:01.464408 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:01.444185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38229 (local address 127.13.88.194:54689)
0923 19:42:01.445061 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:01.445108 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:01.447192 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:01.447855 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:01.447866 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:01.448642 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:01.449448 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:01.449472 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.450432 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.450441 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:01.452614 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:01.452631 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.453333 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.453338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:01.453521 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:01.454184 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:01.454210 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:01.456883 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:01.459738 (+ 2855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:01.459770 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:01.459788 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:01.460405 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:01.460768 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:01.460773 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:01.460778 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:01.461011 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:01.461549 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:01.461558 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:01.462056 (+ 498us) client_negotiation.cc:769] Sending connection context
0923 19:42:01.462375 (+ 319us) client_negotiation.cc:240] Negotiation successful
0923 19:42:01.462915 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":293,"threads_started":1}
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:42:01.465790 17563 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38229
I20260923 19:42:01.466084 17563 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:01.466826 17563 heartbeater.cc:511] Master 127.13.88.254:38229 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
I20260923 19:42:01.468226 17240 ts_manager.cc:194] Registered new tserver with Master: f7b1da9745144a50a34b091ae10bf1de (127.13.88.194:37823)
I20260923 19:42:01.468995 17240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:54689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:42:01.488256 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38229
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:01.800606 17568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:01.800905 17568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:01.801069 17568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:01.808063 17568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:01.808208 17568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:01.808384 17568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:01.817871 17568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:01.819204 17568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:01.820472 17568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:01.833065 17574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:01.833098 17576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:01.833153 17573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:01.834091 17568 server_base.cc:1034] running on GCE node
I20260923 19:42:01.834683 17568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:01.835603 17568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:01.836823 17568 hybrid_clock.cc:648] HybridClock initialized: now 1790192521836788 us; error 46 us; skew 500 ppm
I20260923 19:42:01.837116 17568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:01 dist-test-slave-xg7f krb5kdc[17195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:01.842788 17568 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:42:01.844344 17568 webserver.cc:460] Webserver started at http://127.13.88.195:44511/ using document root <none> and password file <none>
I20260923 19:42:01.844997 17568 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:01.845139 17568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:01.845448 17568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:01.848266 17568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "f593fe4692844cebbf236008fde6050f"
format_stamp: "Formatted at 2026-09-23 19:42:01 on dist-test-slave-xg7f"
server_key: "b73230d950134a857981bbba067cf634"
server_key_iv: "5c1b535213657048c883b5ab1f8d17bc"
server_key_version: "encryptionkey@0"
I20260923 19:42:01.849053 17568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "f593fe4692844cebbf236008fde6050f"
format_stamp: "Formatted at 2026-09-23 19:42:01 on dist-test-slave-xg7f"
server_key: "b73230d950134a857981bbba067cf634"
server_key_iv: "5c1b535213657048c883b5ab1f8d17bc"
server_key_version: "encryptionkey@0"
I20260923 19:42:01.853957 17568 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:42:01.857169 17583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:01.858361 17568 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 19:42:01.858533 17568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "f593fe4692844cebbf236008fde6050f"
format_stamp: "Formatted at 2026-09-23 19:42:01 on dist-test-slave-xg7f"
server_key: "b73230d950134a857981bbba067cf634"
server_key_iv: "5c1b535213657048c883b5ab1f8d17bc"
server_key_version: "encryptionkey@0"
I20260923 19:42:01.858743 17568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:01.877197 17568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:01.881352 17568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:01.881605 17568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:01.882495 17568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:01.883838 17568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:01.883912 17568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:01.884073 17568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:01.884121 17568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:01.915271 17568 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:41025
I20260923 19:42:01.915323 17695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:41025 every 8 connection(s)
I20260923 19:42:01.916543 17568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:01.925616 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17568
I20260923 19:42:01.925814 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:01.926220 13667 external_mini_cluster.cc:1428] Setting key 9d181af37a3960af53ab91902c56dc1e
Sep 23 19:42:01 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:01.935580 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:01.919052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:46469 (local address 127.13.88.254:38229)
0923 19:42:01.919256 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:01.919260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:01.920444 (+ 1184us) server_negotiation.cc:407] Connection header received
0923 19:42:01.922268 (+ 1824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:01.922275 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:01.922357 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:01.922478 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:01.924020 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.924777 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.926417 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.926960 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.927061 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:01.930580 (+ 3519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:01.930584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:01.930588 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:01.930617 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:01.933153 (+ 2536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:01.933761 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:01.933765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:01.933767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:01.933872 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:01.934202 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:01.934204 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:01.934206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:01.934434 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:01.934541 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:01.935193 (+ 652us) server_negotiation.cc:299] Negotiation successful
0923 19:42:01.935341 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260923 19:42:01.936528 17698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:01.919616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38229 (local address 127.13.88.195:46469)
0923 19:42:01.920295 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:01.920332 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:01.921989 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:01.922711 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:01.922720 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:01.923290 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:01.923856 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:01.923877 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.924933 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.924943 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:01.926251 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:01.926263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.927187 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.927195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:01.927474 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:01.928193 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:01.928227 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:01.930404 (+ 2177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:01.933256 (+ 2852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:01.933262 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:01.933273 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:01.933664 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:01.933954 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:01.933956 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:01.933959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:01.934114 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:01.934533 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:01.934538 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:01.934820 (+ 282us) client_negotiation.cc:769] Sending connection context
0923 19:42:01.935049 (+ 229us) client_negotiation.cc:240] Negotiation successful
0923 19:42:01.935467 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":248,"threads_started":1}
I20260923 19:42:01.937831 17696 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38229
I20260923 19:42:01.938074 17696 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:01.938678 17696 heartbeater.cc:511] Master 127.13.88.254:38229 requested a full tablet report, sending...
I20260923 19:42:01.940111 17240 ts_manager.cc:194] Registered new tserver with Master: f593fe4692844cebbf236008fde6050f (127.13.88.195:41025)
I20260923 19:42:01.941100 17240 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:46469
I20260923 19:42:01.941588 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 19:42:01 dist-test-slave-xg7f krb5kdc[17195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
I20260923 19:42:01.978567 17429 heartbeater.cc:503] Master 127.13.88.254:38229 was elected leader, sending a full tablet report...
Sep 23 19:42:01 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:42:01.989163 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:01.974605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35652 (local address 127.13.88.193:33153)
0923 19:42:01.975247 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:01.975255 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:01.975282 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:42:01.975343 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:01.975349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:01.975571 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:01.975696 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:01.976958 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.977963 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.979220 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.979798 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.979896 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:01.983804 (+ 3908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:01.983815 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:01.983830 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:01.983863 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:01.986735 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:01.987429 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:01.987437 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:01.987439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:01.987563 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:01.987873 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:01.987876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:01.987878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:01.988188 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:01.988396 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:01.988595 (+ 199us) server_negotiation.cc:299] Negotiation successful
0923 19:42:01.988771 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":306,"threads_started":1}
Sep 23 19:42:01 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:02.006114 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:01.993165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37824 (local address 127.13.88.254:38229)
0923 19:42:01.993372 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:01.993378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:01.993574 (+ 196us) server_negotiation.cc:407] Connection header received
0923 19:42:01.993768 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:01.993773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:01.993845 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:01.993943 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:01.995146 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.995880 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.997125 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:01.997552 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:01.997700 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:02.001562 (+ 3862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:02.001566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:02.001570 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:02.001601 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:02.004075 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.004633 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.004637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.004639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.004754 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.005032 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.005035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.005037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.005322 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:02.005490 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:02.005732 (+ 242us) server_negotiation.cc:299] Negotiation successful
0923 19:42:02.005881 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260923 19:42:02.006644 17240 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37824
I20260923 19:42:02.007637 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17301
I20260923 19:42:02.021153 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:02.008672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35668 (local address 127.13.88.193:33153)
0923 19:42:02.008895 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:02.008901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:02.009405 (+ 504us) server_negotiation.cc:407] Connection header received
0923 19:42:02.009590 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:02.009595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:02.009725 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:02.009832 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:02.011288 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:02.011988 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:02.013164 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:02.013573 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:02.013708 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:02.016006 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:02.016012 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:02.016016 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:02.016052 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:02.018612 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.019290 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.019296 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.019300 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.019420 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.019775 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.019780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.019783 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.020096 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:02.020336 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:02.020627 (+ 291us) server_negotiation.cc:299] Negotiation successful
0923 19:42:02.020840 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:42:02.021718 17424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:02.103528 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17301
I20260923 19:42:02.119483 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17435
Sep 23 19:42:02 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:42:02.134552 17708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:02.120407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43718 (local address 127.13.88.194:37823)
0923 19:42:02.120912 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:02.120919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:02.120945 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:42:02.121001 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:02.121007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:02.121211 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:02.121334 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:02.122480 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:02.123502 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:02.124778 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:02.125307 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:02.125399 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:02.129347 (+ 3948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:02.129357 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:02.129371 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:02.129405 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:02.132247 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.132795 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.132801 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.132804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.132921 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.133238 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.133240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.133242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.133560 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:02.133764 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:02.133996 (+ 232us) server_negotiation.cc:299] Negotiation successful
0923 19:42:02.134171 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":260,"threads_started":1}
I20260923 19:42:02.135864 17558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:02.216807 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17435
I20260923 19:42:02.232824 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17568
Sep 23 19:42:02 dist-test-slave-xg7f krb5kdc[17195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:42:02.248226 17710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:02.233869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39192 (local address 127.13.88.195:41025)
0923 19:42:02.234509 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:02.234516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:02.234543 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:42:02.234601 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:02.234608 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:02.234815 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:02.234943 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:02.236199 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:02.237164 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:02.238294 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:02.238813 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:02.238901 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:02.242969 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:02.242980 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:02.242993 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:02.243026 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:02.245848 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.246409 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.246431 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.246434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.246555 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:02.246831 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:02.246834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:02.246835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:02.247224 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:02.247477 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:02.247663 (+ 186us) server_negotiation.cc:299] Negotiation successful
0923 19:42:02.247843 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":336,"threads_started":1}
I20260923 19:42:02.249421 17691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:02.331238 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17568
I20260923 19:42:02.346576 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17208
I20260923 19:42:02.347718 17270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:02.447888 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17208
2026-09-23T19:42:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3739 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:42:02 dist-test-slave-xg7f krb5kdc[17715](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:42:02 dist-test-slave-xg7f krb5kdc[17715](info): set up 2 sockets
Sep 23 19:42:02 dist-test-slave-xg7f krb5kdc[17715](info): commencing operation
krb5kdc: starting...
W20260923 19:42:03.503499 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.006s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:42:03 dist-test-slave-xg7f krb5kdc[17715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:42:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:42:03.690361 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42453
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:42453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:04.000243 17728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:04.000527 17728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:04.000618 17728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:04.007550 17728 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:04.007645 17728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:04.007689 17728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:04.007742 17728 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:04.007790 17728 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:04.018612 17728 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:42453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:04.019797 17728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:04.020994 17728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:04.032008 17734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:04.032239 17733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:04.032049 17736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:04.032819 17728 server_base.cc:1034] running on GCE node
I20260923 19:42:04.033591 17728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:04.034857 17728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:04.036048 17728 hybrid_clock.cc:648] HybridClock initialized: now 1790192524036001 us; error 36 us; skew 500 ppm
I20260923 19:42:04.036414 17728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:04 dist-test-slave-xg7f krb5kdc[17715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192524, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:04.039436 17728 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:42:04.040534 17728 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:04.040664 17728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:04.040980 17728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:04.043849 17728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "0d091ea97117464fab3bb256d8bc0281"
format_stamp: "Formatted at 2026-09-23 19:42:04 on dist-test-slave-xg7f"
server_key: "b4905ebcddca9a32b1961d76f9e23628"
server_key_iv: "ac53e6f8f862d22626262d8ea2e72eef"
server_key_version: "encryptionkey@0"
I20260923 19:42:04.044625 17728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "0d091ea97117464fab3bb256d8bc0281"
format_stamp: "Formatted at 2026-09-23 19:42:04 on dist-test-slave-xg7f"
server_key: "b4905ebcddca9a32b1961d76f9e23628"
server_key_iv: "ac53e6f8f862d22626262d8ea2e72eef"
server_key_version: "encryptionkey@0"
I20260923 19:42:04.049739 17728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:42:04.052999 17742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:04.054158 17728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 19:42:04.054339 17728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "0d091ea97117464fab3bb256d8bc0281"
format_stamp: "Formatted at 2026-09-23 19:42:04 on dist-test-slave-xg7f"
server_key: "b4905ebcddca9a32b1961d76f9e23628"
server_key_iv: "ac53e6f8f862d22626262d8ea2e72eef"
server_key_version: "encryptionkey@0"
I20260923 19:42:04.054561 17728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:04.068905 17728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:04.072549 17728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:04.072803 17728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:04.090140 17728 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:42453
I20260923 19:42:04.090159 17793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:42453 every 8 connection(s)
I20260923 19:42:04.090994 17728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:04.094549 17794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:04.098217 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17728
I20260923 19:42:04.098459 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:04.099285 13667 external_mini_cluster.cc:1428] Setting key 9eba7496f7e0b0189bbc375cd3c81c02
I20260923 19:42:04.107939 17794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281: Bootstrap starting.
I20260923 19:42:04.111605 17794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:04.112896 17794 log.cc:824] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:42:04 dist-test-slave-xg7f krb5kdc[17715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:04.115628 17794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281: No bootstrap required, opened a new log
I20260923 19:42:04.121578 17797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:04.101363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39290 (local address 127.13.88.254:42453)
0923 19:42:04.102182 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:04.102194 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:04.102233 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:42:04.103823 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:04.103844 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:04.104256 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:04.104580 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:04.106403 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:04.107712 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:04.109462 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:04.110118 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:04.110240 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:04.114680 (+ 4440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:04.114687 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:04.114701 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:04.114732 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:04.117698 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:04.118359 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:04.118364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:04.118369 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:04.118549 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:04.118908 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:04.118915 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:04.118918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:04.119499 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:04.119803 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:04.120229 (+ 426us) server_negotiation.cc:299] Negotiation successful
0923 19:42:04.120618 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":400,"threads_started":1}
I20260923 19:42:04.123215 17794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d091ea97117464fab3bb256d8bc0281" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42453 } }
I20260923 19:42:04.123557 17794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:04.123663 17794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d091ea97117464fab3bb256d8bc0281, State: Initialized, Role: FOLLOWER
I20260923 19:42:04.124234 17794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d091ea97117464fab3bb256d8bc0281" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42453 } }
I20260923 19:42:04.124491 17794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:04.124663 17794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:04.124814 17794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:04.126853 17794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d091ea97117464fab3bb256d8bc0281" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42453 } }
I20260923 19:42:04.127324 17794 leader_election.cc:302] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d091ea97117464fab3bb256d8bc0281; no voters:
I20260923 19:42:04.127789 17794 leader_election.cc:288] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:04.127930 17799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:04.128859 17799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [term 1 LEADER]: Becoming Leader. State: Replica: 0d091ea97117464fab3bb256d8bc0281, State: Running, Role: LEADER
I20260923 19:42:04.129535 17799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d091ea97117464fab3bb256d8bc0281" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42453 } }
I20260923 19:42:04.130769 17794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:04.132930 17800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d091ea97117464fab3bb256d8bc0281. Latest consensus state: current_term: 1 leader_uuid: "0d091ea97117464fab3bb256d8bc0281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d091ea97117464fab3bb256d8bc0281" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42453 } } }
I20260923 19:42:04.133359 17800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:04.133266 17801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d091ea97117464fab3bb256d8bc0281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d091ea97117464fab3bb256d8bc0281" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42453 } } }
I20260923 19:42:04.133649 17801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:04.135440 17807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:04.141274 17807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:04.149704 17807 catalog_manager.cc:1347] Generated new cluster ID: 47337344a3fb41468c94536d6f0a420a
I20260923 19:42:04.149818 17807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:04.166023 17807 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:04.167361 17807 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:04.173262 17807 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281: Generated new TSK 0
I20260923 19:42:04.174219 17807 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:42:04.226835 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42453
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:04.566713 17820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:04.567008 17820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:04.567188 17820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:04.574142 17820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:04.574232 17820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:04.574395 17820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:04.583724 17820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:04.584992 17820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:04.586331 17820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:04.598869 17825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:04.598984 17826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:04.599006 17828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:04.599884 17820 server_base.cc:1034] running on GCE node
I20260923 19:42:04.600489 17820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:04.601322 17820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:04.602507 17820 hybrid_clock.cc:648] HybridClock initialized: now 1790192524602469 us; error 31 us; skew 500 ppm
I20260923 19:42:04.602828 17820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:04 dist-test-slave-xg7f krb5kdc[17715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192524, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:04.605844 17820 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:42:04.606993 17820 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:04.607112 17820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:04.607470 17820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:04.610339 17820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97"
format_stamp: "Formatted at 2026-09-23 19:42:04 on dist-test-slave-xg7f"
server_key: "560c10d54229ae4aa90db5603b17cd7d"
server_key_iv: "b369a9cf3151b8b2c2421c7581b9e416"
server_key_version: "encryptionkey@0"
I20260923 19:42:04.611238 17820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97"
format_stamp: "Formatted at 2026-09-23 19:42:04 on dist-test-slave-xg7f"
server_key: "560c10d54229ae4aa90db5603b17cd7d"
server_key_iv: "b369a9cf3151b8b2c2421c7581b9e416"
server_key_version: "encryptionkey@0"
I20260923 19:42:04.616086 17820 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:42:04.619295 17834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:04.620568 17820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:42:04.620721 17820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97"
format_stamp: "Formatted at 2026-09-23 19:42:04 on dist-test-slave-xg7f"
server_key: "560c10d54229ae4aa90db5603b17cd7d"
server_key_iv: "b369a9cf3151b8b2c2421c7581b9e416"
server_key_version: "encryptionkey@0"
I20260923 19:42:04.620987 17820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:04.644711 17820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:04.648715 17820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:04.648988 17820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:04.649900 17820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:04.651295 17820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:04.651427 17820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:04.651548 17820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:04.651635 17820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:04.683153 17820 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:46399
I20260923 19:42:04.683241 17946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:46399 every 8 connection(s)
I20260923 19:42:04.684026 17820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:04.686928 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17820
I20260923 19:42:04.687170 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:04.687973 13667 external_mini_cluster.cc:1428] Setting key 7c263aff6803846083279f4a113de757
Sep 23 19:42:04 dist-test-slave-xg7f krb5kdc[17715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192524, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:04.704957 17949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:04.686403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:43683 (local address 127.13.88.254:42453)
0923 19:42:04.686821 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:04.686826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:04.687965 (+ 1139us) server_negotiation.cc:407] Connection header received
0923 19:42:04.689728 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:04.689733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:04.689821 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:04.689942 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:04.691443 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:04.692162 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:04.693686 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:04.694080 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:04.694209 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:04.698080 (+ 3871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:04.698089 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:04.698096 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:04.698141 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:04.701667 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:04.702382 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:04.702402 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:04.702408 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:04.702562 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:04.703008 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:04.703015 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:04.703020 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:04.703436 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:04.703612 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:04.704279 (+ 667us) server_negotiation.cc:299] Negotiation successful
0923 19:42:04.704547 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":232,"threads_started":1}
I20260923 19:42:04.705590 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:04.687046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42453 (local address 127.13.88.193:43683)
0923 19:42:04.687808 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:04.687850 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:04.689473 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:04.690168 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:04.690176 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:04.690665 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:04.691286 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:04.691304 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:04.692328 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:04.692334 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:04.693535 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:04.693546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:04.694295 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:04.694303 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:04.694521 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:04.695268 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:04.695301 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:04.697868 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:04.701797 (+ 3929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:04.701805 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:04.701818 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:04.702248 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:04.702709 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:04.702721 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:04.702724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:04.702886 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:04.703571 (+ 685us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:04.703577 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:04.703884 (+ 307us) client_negotiation.cc:769] Sending connection context
0923 19:42:04.704103 (+ 219us) client_negotiation.cc:240] Negotiation successful
0923 19:42:04.704478 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":314,"threads_started":1}
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:42:04.707212 17947 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42453
I20260923 19:42:04.707525 17947 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:04.708495 17947 heartbeater.cc:511] Master 127.13.88.254:42453 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
I20260923 19:42:04.710943 17759 ts_manager.cc:194] Registered new tserver with Master: 5fa6e53b96f6474b8cc732d5c9aa2a97 (127.13.88.193:46399)
I20260923 19:42:04.713143 17759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:43683
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:42:04.731861 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42453
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:05.044678 17953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:05.044989 17953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:05.045156 17953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:05.052235 17953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:05.052374 17953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:05.052561 17953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:05.062055 17953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:05.063288 17953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:05.064594 17953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:05.077378 17959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:05.077319 17961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:05.077703 17958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:05.078435 17953 server_base.cc:1034] running on GCE node
I20260923 19:42:05.079068 17953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:05.080122 17953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:05.081346 17953 hybrid_clock.cc:648] HybridClock initialized: now 1790192525081301 us; error 56 us; skew 500 ppm
I20260923 19:42:05.081658 17953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:05 dist-test-slave-xg7f krb5kdc[17715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192525, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:05.084707 17953 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:42:05.085783 17953 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:05.085908 17953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:05.086212 17953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:05.089057 17953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "5a3557d95c1942b581eeb20b9c207b5d"
format_stamp: "Formatted at 2026-09-23 19:42:05 on dist-test-slave-xg7f"
server_key: "f1abbd8869bee1cc07c068a648b6cbf0"
server_key_iv: "cf503f9a6543bf75e74575eeaa30d2cf"
server_key_version: "encryptionkey@0"
I20260923 19:42:05.089959 17953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "5a3557d95c1942b581eeb20b9c207b5d"
format_stamp: "Formatted at 2026-09-23 19:42:05 on dist-test-slave-xg7f"
server_key: "f1abbd8869bee1cc07c068a648b6cbf0"
server_key_iv: "cf503f9a6543bf75e74575eeaa30d2cf"
server_key_version: "encryptionkey@0"
I20260923 19:42:05.095999 17953 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260923 19:42:05.099984 17967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:05.101347 17953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:05.101481 17953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "5a3557d95c1942b581eeb20b9c207b5d"
format_stamp: "Formatted at 2026-09-23 19:42:05 on dist-test-slave-xg7f"
server_key: "f1abbd8869bee1cc07c068a648b6cbf0"
server_key_iv: "cf503f9a6543bf75e74575eeaa30d2cf"
server_key_version: "encryptionkey@0"
I20260923 19:42:05.101696 17953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:05.123076 17953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:05.127462 17953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:05.127701 17953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:05.128559 17953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:05.129822 17953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:05.129905 17953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:05.129980 17953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:05.130035 17953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:05.162060 17953 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:40039
I20260923 19:42:05.162107 18079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:40039 every 8 connection(s)
I20260923 19:42:05.162869 17953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:05.169008 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 17953
I20260923 19:42:05.169195 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:05.169631 13667 external_mini_cluster.cc:1428] Setting key db8197a24394cbe62dea428c629ce1da
Sep 23 19:42:05 dist-test-slave-xg7f krb5kdc[17715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192525, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:05.182448 17949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.165283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:39493 (local address 127.13.88.254:42453)
0923 19:42:05.165460 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.165464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.166489 (+ 1025us) server_negotiation.cc:407] Connection header received
0923 19:42:05.168374 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.168379 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.168465 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.168570 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:05.170210 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.170998 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.172699 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.173155 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.173297 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.176773 (+ 3476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:05.176777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:05.176781 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:05.176811 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:05.179374 (+ 2563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:05.180244 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:05.180247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:05.180250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:05.180369 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:05.180835 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:05.180837 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:05.180839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:05.181065 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:05.181164 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.182053 (+ 889us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.182212 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:42:05.184132 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.165690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42453 (local address 127.13.88.194:39493)
0923 19:42:05.166327 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:05.166371 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:05.168127 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:05.168798 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:05.168805 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:05.169407 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:05.170014 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.170030 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.171185 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.171190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.172556 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.172568 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.173377 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.173384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.173615 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.174282 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:05.174302 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:05.176550 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:05.179498 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:05.179510 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:05.179529 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:05.180133 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:05.180484 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:05.180492 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:05.180498 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:05.180728 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:05.181190 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:05.181201 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:05.181638 (+ 437us) client_negotiation.cc:769] Sending connection context
0923 19:42:05.181953 (+ 315us) client_negotiation.cc:240] Negotiation successful
0923 19:42:05.182527 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":263,"threads_started":1}
I20260923 19:42:05.185678 18080 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42453
I20260923 19:42:05.186026 18080 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:05.186826 18080 heartbeater.cc:511] Master 127.13.88.254:42453 requested a full tablet report, sending...
I20260923 19:42:05.188458 17759 ts_manager.cc:194] Registered new tserver with Master: 5a3557d95c1942b581eeb20b9c207b5d (127.13.88.194:40039)
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:42:05.189245 17759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:39493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:42:05.212221 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42453
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:05.519920 18085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:05.520195 18085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:05.520289 18085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:05.527577 18085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:05.527681 18085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:05.527796 18085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:05.537540 18085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42453
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:05.538751 18085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:05.540011 18085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:05.552065 18090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:05.552130 18093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:05.552163 18091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:05.552897 18085 server_base.cc:1034] running on GCE node
I20260923 19:42:05.553435 18085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:05.554268 18085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:05.555454 18085 hybrid_clock.cc:648] HybridClock initialized: now 1790192525555412 us; error 44 us; skew 500 ppm
I20260923 19:42:05.555721 18085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:05 dist-test-slave-xg7f krb5kdc[17715](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192525, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:05.558619 18085 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:42:05.559796 18085 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:05.559902 18085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:05.560212 18085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:05.562958 18085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "905a4d7e6a36415282bc0a3da52158e0"
format_stamp: "Formatted at 2026-09-23 19:42:05 on dist-test-slave-xg7f"
server_key: "fc7e9de904d78862cbfce586eaa64737"
server_key_iv: "02972a9b3f66f10ca3eeef3df4c4140b"
server_key_version: "encryptionkey@0"
I20260923 19:42:05.563804 18085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "905a4d7e6a36415282bc0a3da52158e0"
format_stamp: "Formatted at 2026-09-23 19:42:05 on dist-test-slave-xg7f"
server_key: "fc7e9de904d78862cbfce586eaa64737"
server_key_iv: "02972a9b3f66f10ca3eeef3df4c4140b"
server_key_version: "encryptionkey@0"
I20260923 19:42:05.568593 18085 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:42:05.572244 18099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:05.573510 18085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:42:05.573675 18085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "905a4d7e6a36415282bc0a3da52158e0"
format_stamp: "Formatted at 2026-09-23 19:42:05 on dist-test-slave-xg7f"
server_key: "fc7e9de904d78862cbfce586eaa64737"
server_key_iv: "02972a9b3f66f10ca3eeef3df4c4140b"
server_key_version: "encryptionkey@0"
I20260923 19:42:05.573886 18085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:05.593407 18085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:05.597278 18085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:05.597543 18085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:05.598487 18085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:05.599969 18085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:05.600082 18085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:05.600215 18085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:05.600301 18085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:05.632655 18085 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:46649
I20260923 19:42:05.632740 18211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:46649 every 8 connection(s)
I20260923 19:42:05.633519 18085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:05.638597 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 18085
I20260923 19:42:05.638783 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:05.639249 13667 external_mini_cluster.cc:1428] Setting key d654b7c32efda248e1d6cfacc08c6d1d
Sep 23 19:42:05 dist-test-slave-xg7f krb5kdc[17715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192525, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:05.651978 17949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.635897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:38529 (local address 127.13.88.254:42453)
0923 19:42:05.636131 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.636138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.637287 (+ 1149us) server_negotiation.cc:407] Connection header received
0923 19:42:05.639123 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.639129 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.639219 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.639324 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:05.640998 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.641878 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.643394 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.643811 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.643904 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.647047 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:05.647051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:05.647054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:05.647082 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:05.649413 (+ 2331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:05.650087 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:05.650090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:05.650092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:05.650210 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:05.650560 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:05.650563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:05.650564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:05.650802 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:05.650909 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.651568 (+ 659us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.651722 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:42:05.653127 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.636457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42453 (local address 127.13.88.195:38529)
0923 19:42:05.637121 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:05.637159 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:05.638815 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:05.639544 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:05.639552 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:05.640144 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:05.640768 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.640792 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.642021 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.642032 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.643253 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.643264 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.643983 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.643987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.644170 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.644849 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:05.644869 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:05.646882 (+ 2013us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:05.649554 (+ 2672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:05.649560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:05.649572 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:05.649986 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:05.650306 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:05.650309 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:05.650311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:05.650472 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:05.650907 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:05.650912 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:05.651254 (+ 342us) client_negotiation.cc:769] Sending connection context
0923 19:42:05.651486 (+ 232us) client_negotiation.cc:240] Negotiation successful
0923 19:42:05.651856 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":265,"threads_started":1}
I20260923 19:42:05.654565 18212 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42453
I20260923 19:42:05.654858 18212 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:05.655524 18212 heartbeater.cc:511] Master 127.13.88.254:42453 requested a full tablet report, sending...
I20260923 19:42:05.656836 17758 ts_manager.cc:194] Registered new tserver with Master: 905a4d7e6a36415282bc0a3da52158e0 (127.13.88.195:46649)
I20260923 19:42:05.657708 17758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:38529
I20260923 19:42:05.666651 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:42:05.684294 17949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.671946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39296 (local address 127.13.88.254:42453)
0923 19:42:05.672120 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.672125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.672696 (+ 571us) server_negotiation.cc:407] Connection header received
0923 19:42:05.672828 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.672832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.672892 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.672970 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:05.674325 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.675037 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.676273 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.676788 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.676941 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.679168 (+ 2227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:05.679173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:05.679176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:05.679206 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:05.681705 (+ 2499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:05.682254 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:05.682257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:05.682260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:05.682376 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:05.682789 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:05.682793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:05.682796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:05.683086 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:05.683324 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.683753 (+ 429us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.683965 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:42:05.688896 17758 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39296:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:42:05.695372 17758 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:05.716118 17947 heartbeater.cc:503] Master 127.13.88.254:42453 was elected leader, sending a full tablet report...
I20260923 19:42:05.718436 18226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.706527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55170 (local address 127.13.88.193:46399)
0923 19:42:05.707818 (+ 1291us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.707827 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.708664 (+ 837us) server_negotiation.cc:407] Connection header received
0923 19:42:05.708772 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.708783 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.709062 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.709283 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:05.710271 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.712209 (+ 1938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.715486 (+ 3277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.717009 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.717139 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.717366 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.717962 (+ 596us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.718119 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1069,"thread_start_us":888,"threads_started":1}
I20260923 19:42:05.718472 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.706265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:46399 (local address 127.0.0.1:55170)
0923 19:42:05.708227 (+ 1962us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:05.708280 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:05.708472 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:05.709563 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:05.709573 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:05.709617 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:05.710069 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.710084 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.712400 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.712409 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.715272 (+ 2863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.715297 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.717494 (+ 2197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.717502 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.717695 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.717749 (+ 54us) client_negotiation.cc:769] Sending connection context
0923 19:42:05.717899 (+ 150us) client_negotiation.cc:240] Negotiation successful
0923 19:42:05.718074 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1668,"thread_start_us":1493,"threads_started":1}
I20260923 19:42:05.722345 17882 tablet_service.cc:1467] Processing CreateTablet for tablet 6465f4b1a55040f193debd8af6f9df35 (DEFAULT_TABLE table=test-table [id=84b7b04032b44efbab85d55805104ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:05.723829 18225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.706432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:46649 (local address 127.0.0.1:56904)
0923 19:42:05.715672 (+ 9240us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:05.715696 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:05.715845 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:05.717093 (+ 1248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:05.717097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:05.717119 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:05.717544 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.717557 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.719376 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.719383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.721399 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.721414 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.722983 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.722989 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.723172 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.723208 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 19:42:05.723327 (+ 119us) client_negotiation.cc:240] Negotiation successful
0923 19:42:05.723477 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9056,"thread_start_us":8877,"threads_started":1}
I20260923 19:42:05.724121 17882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6465f4b1a55040f193debd8af6f9df35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:05.723884 18227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.706964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56904 (local address 127.13.88.195:46649)
0923 19:42:05.715145 (+ 8181us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.715163 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.716137 (+ 974us) server_negotiation.cc:407] Connection header received
0923 19:42:05.716366 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.716375 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.716637 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.716823 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:05.717761 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.719258 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.721560 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.722793 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.722938 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.723169 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.723379 (+ 210us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.723531 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7934,"thread_start_us":7758,"threads_started":1}
I20260923 19:42:05.725263 18229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.708755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55224 (local address 127.13.88.194:40039)
0923 19:42:05.715870 (+ 7115us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.715878 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.716460 (+ 582us) server_negotiation.cc:407] Connection header received
0923 19:42:05.717568 (+ 1108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.717576 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.717781 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.717941 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:05.718777 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.720245 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.722463 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.723858 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.724052 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.724248 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.724791 (+ 543us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.724946 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6949,"thread_start_us":7151,"threads_started":1}
I20260923 19:42:05.725303 18228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.708537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:40039 (local address 127.0.0.1:55224)
0923 19:42:05.716207 (+ 7670us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:05.716224 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:05.716344 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:05.718144 (+ 1800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:05.718149 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:05.718175 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:05.718580 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.718592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.720404 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.720409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.722288 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.722301 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.724444 (+ 2143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.724450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.724629 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.724658 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:42:05.724755 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 19:42:05.724866 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7566,"mutex_wait_us":59,"thread_start_us":7997,"threads_started":1}
I20260923 19:42:05.728048 18147 tablet_service.cc:1467] Processing CreateTablet for tablet 6465f4b1a55040f193debd8af6f9df35 (DEFAULT_TABLE table=test-table [id=84b7b04032b44efbab85d55805104ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:05.728232 18015 tablet_service.cc:1467] Processing CreateTablet for tablet 6465f4b1a55040f193debd8af6f9df35 (DEFAULT_TABLE table=test-table [id=84b7b04032b44efbab85d55805104ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:05.729244 18015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6465f4b1a55040f193debd8af6f9df35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:05.729322 18147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6465f4b1a55040f193debd8af6f9df35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:05.739121 18230 tablet_bootstrap.cc:492] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Bootstrap starting.
I20260923 19:42:05.741078 18231 tablet_bootstrap.cc:492] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Bootstrap starting.
I20260923 19:42:05.742727 18230 tablet_bootstrap.cc:654] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:05.744115 18230 log.cc:824] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:05.744565 18232 tablet_bootstrap.cc:492] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Bootstrap starting.
I20260923 19:42:05.745095 18231 tablet_bootstrap.cc:654] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:05.746425 18231 log.cc:824] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:05.747975 18230 tablet_bootstrap.cc:492] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: No bootstrap required, opened a new log
I20260923 19:42:05.747991 18232 tablet_bootstrap.cc:654] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:05.748253 18230 ts_tablet_manager.cc:1397] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260923 19:42:05.749114 18231 tablet_bootstrap.cc:492] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: No bootstrap required, opened a new log
I20260923 19:42:05.749154 18232 log.cc:824] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:05.749398 18231 ts_tablet_manager.cc:1397] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260923 19:42:05.752769 18232 tablet_bootstrap.cc:492] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: No bootstrap required, opened a new log
I20260923 19:42:05.753039 18232 ts_tablet_manager.cc:1397] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260923 19:42:05.756850 18231 raft_consensus.cc:348] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.757223 18231 raft_consensus.cc:374] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:05.757320 18231 raft_consensus.cc:729] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a3557d95c1942b581eeb20b9c207b5d, State: Initialized, Role: FOLLOWER
I20260923 19:42:05.757989 18231 consensus_queue.cc:260] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.758459 18230 raft_consensus.cc:348] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.758911 18230 raft_consensus.cc:374] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:05.759038 18230 raft_consensus.cc:729] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fa6e53b96f6474b8cc732d5c9aa2a97, State: Initialized, Role: FOLLOWER
I20260923 19:42:05.759176 18080 heartbeater.cc:503] Master 127.13.88.254:42453 was elected leader, sending a full tablet report...
I20260923 19:42:05.759685 18230 consensus_queue.cc:260] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.761364 18230 ts_tablet_manager.cc:1428] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260923 19:42:05.762431 18231 ts_tablet_manager.cc:1428] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260923 19:42:05.763355 18232 raft_consensus.cc:348] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.763761 18232 raft_consensus.cc:374] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:05.763963 18232 raft_consensus.cc:729] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 905a4d7e6a36415282bc0a3da52158e0, State: Initialized, Role: FOLLOWER
I20260923 19:42:05.764525 18232 consensus_queue.cc:260] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.765637 18212 heartbeater.cc:503] Master 127.13.88.254:42453 was elected leader, sending a full tablet report...
I20260923 19:42:05.767292 18232 ts_tablet_manager.cc:1428] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260923 19:42:05.859148 18238 raft_consensus.cc:482] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:05.859508 18238 raft_consensus.cc:504] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.861279 18238 leader_election.cc:288] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fa6e53b96f6474b8cc732d5c9aa2a97 (127.13.88.193:46399), 5a3557d95c1942b581eeb20b9c207b5d (127.13.88.194:40039)
I20260923 19:42:05.868140 18229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.861851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:54015 (local address 127.13.88.194:40039)
0923 19:42:05.862100 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.862108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.862135 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:42:05.862218 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.862225 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.862304 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.862410 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:05.862823 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.863936 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.866341 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.867237 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.867402 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.867492 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.867758 (+ 266us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.867887 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 19:42:05.868191 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.861581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:40039 (local address 127.13.88.195:54015)
0923 19:42:05.861908 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:05.861945 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:05.862085 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:05.862458 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:05.862465 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:05.862492 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:05.862690 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.862699 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.864063 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.864067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.866180 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.866195 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.867392 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.867398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.867600 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.867624 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 19:42:05.867733 (+ 109us) client_negotiation.cc:240] Negotiation successful
0923 19:42:05.867866 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":1}
I20260923 19:42:05.868248 18226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.861761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:56047 (local address 127.13.88.193:46399)
0923 19:42:05.861936 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.861944 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.862507 (+ 563us) server_negotiation.cc:407] Connection header received
0923 19:42:05.862640 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.862643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.862699 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.862802 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:05.863303 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.864242 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.866521 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.867344 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.867524 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.867598 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.867865 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.868001 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:42:05.868363 18239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.861617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:46399 (local address 127.13.88.195:56047)
0923 19:42:05.862363 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:05.862400 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:05.862513 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:05.862815 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:05.862819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:05.862850 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:05.863160 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.863174 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.864370 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.864374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.866378 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:05.866388 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.867554 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.867560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:05.867713 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.867735 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:42:05.867838 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 19:42:05.867964 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":483,"threads_started":1}
I20260923 19:42:05.869449 18035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6465f4b1a55040f193debd8af6f9df35" candidate_uuid: "905a4d7e6a36415282bc0a3da52158e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a3557d95c1942b581eeb20b9c207b5d" is_pre_election: true
I20260923 19:42:05.869465 17902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6465f4b1a55040f193debd8af6f9df35" candidate_uuid: "905a4d7e6a36415282bc0a3da52158e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" is_pre_election: true
I20260923 19:42:05.870035 18035 raft_consensus.cc:2454] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 905a4d7e6a36415282bc0a3da52158e0 in term 0.
I20260923 19:42:05.870035 17902 raft_consensus.cc:2454] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 905a4d7e6a36415282bc0a3da52158e0 in term 0.
I20260923 19:42:05.870764 18100 leader_election.cc:302] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a3557d95c1942b581eeb20b9c207b5d, 905a4d7e6a36415282bc0a3da52158e0; no voters:
I20260923 19:42:05.871246 18238 raft_consensus.cc:2781] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:05.871387 18238 raft_consensus.cc:482] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:05.871495 18238 raft_consensus.cc:3037] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:05.873636 18238 raft_consensus.cc:504] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.874200 18238 leader_election.cc:288] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [CANDIDATE]: Term 1 election: Requested vote from peers 5fa6e53b96f6474b8cc732d5c9aa2a97 (127.13.88.193:46399), 5a3557d95c1942b581eeb20b9c207b5d (127.13.88.194:40039)
I20260923 19:42:05.874675 17902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6465f4b1a55040f193debd8af6f9df35" candidate_uuid: "905a4d7e6a36415282bc0a3da52158e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97"
I20260923 19:42:05.874675 18035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6465f4b1a55040f193debd8af6f9df35" candidate_uuid: "905a4d7e6a36415282bc0a3da52158e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a3557d95c1942b581eeb20b9c207b5d"
I20260923 19:42:05.874877 18035 raft_consensus.cc:3037] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:05.874878 17902 raft_consensus.cc:3037] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:05.878012 18035 raft_consensus.cc:2454] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 905a4d7e6a36415282bc0a3da52158e0 in term 1.
I20260923 19:42:05.878014 17902 raft_consensus.cc:2454] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 905a4d7e6a36415282bc0a3da52158e0 in term 1.
I20260923 19:42:05.878402 18100 leader_election.cc:302] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5a3557d95c1942b581eeb20b9c207b5d, 5fa6e53b96f6474b8cc732d5c9aa2a97, 905a4d7e6a36415282bc0a3da52158e0; no voters:
I20260923 19:42:05.878706 18238 raft_consensus.cc:2781] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:05.879184 18238 raft_consensus.cc:686] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 1 LEADER]: Becoming Leader. State: Replica: 905a4d7e6a36415282bc0a3da52158e0, State: Running, Role: LEADER
I20260923 19:42:05.879642 18238 consensus_queue.cc:237] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } }
I20260923 19:42:05.883972 17758 catalog_manager.cc:5495] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 905a4d7e6a36415282bc0a3da52158e0 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "905a4d7e6a36415282bc0a3da52158e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "905a4d7e6a36415282bc0a3da52158e0" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 } health_report { overall_health: UNKNOWN } } }
W20260923 19:42:05.884917 18213 tablet.cc:2369] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:42:05.914662 18227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.909695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56920 (local address 127.13.88.195:46649)
0923 19:42:05.909910 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.909930 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.910057 (+ 127us) server_negotiation.cc:407] Connection header received
0923 19:42:05.910228 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.910231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.910321 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.910453 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:05.910759 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.911508 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.912750 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.913125 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.913210 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.913602 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:05.914132 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:05.914249 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:05.914309 (+ 60us) server_negotiation.cc:299] Negotiation successful
0923 19:42:05.914368 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260923 19:42:05.914748 18081 tablet.cc:2369] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:42:05.922318 18035 raft_consensus.cc:1261] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 1 FOLLOWER]: Refusing update from remote peer 905a4d7e6a36415282bc0a3da52158e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:05.922318 17902 raft_consensus.cc:1261] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 1 FOLLOWER]: Refusing update from remote peer 905a4d7e6a36415282bc0a3da52158e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:05.923329 18240 consensus_queue.cc:1035] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fa6e53b96f6474b8cc732d5c9aa2a97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:05.923658 18238 consensus_queue.cc:1035] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a3557d95c1942b581eeb20b9c207b5d" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:05.947701 17758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:05.947909 17758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39296:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:05.951280 17758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d091ea97117464fab3bb256d8bc0281: Sending DeleteTablet for 3 replicas of tablet 6465f4b1a55040f193debd8af6f9df35
I20260923 19:42:05.952380 17882 tablet_service.cc:1514] Processing DeleteTablet for tablet 6465f4b1a55040f193debd8af6f9df35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:05 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:55170
I20260923 19:42:05.952392 18147 tablet_service.cc:1514] Processing DeleteTablet for tablet 6465f4b1a55040f193debd8af6f9df35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:05 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:56904
I20260923 19:42:05.952715 18015 tablet_service.cc:1514] Processing DeleteTablet for tablet 6465f4b1a55040f193debd8af6f9df35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:05 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:55224
I20260923 19:42:05.955053 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17820
I20260923 19:42:05.988533 18253 tablet_replica.cc:330] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: stopping tablet replica
I20260923 19:42:05.989673 18252 tablet_replica.cc:330] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: stopping tablet replica
I20260923 19:42:05.990193 18252 raft_consensus.cc:2229] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:05.990759 18254 tablet_replica.cc:330] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: stopping tablet replica
I20260923 19:42:05.990923 18252 raft_consensus.cc:2258] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:05.991253 18254 raft_consensus.cc:2229] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:05.991659 18253 raft_consensus.cc:2229] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:05.991950 18254 raft_consensus.cc:2258] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:05.992193 18253 raft_consensus.cc:2258] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:05.994194 18253 ts_tablet_manager.cc:1905] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:05.994194 18254 ts_tablet_manager.cc:1905] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:42:05 dist-test-slave-xg7f krb5kdc[17715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:42:05.996457 18252 ts_tablet_manager.cc:1905] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:06.001643 18253 ts_tablet_manager.cc:1918] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:06.001866 18253 log.cc:1196] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/6465f4b1a55040f193debd8af6f9df35
I20260923 19:42:06.002444 18253 ts_tablet_manager.cc:1939] T 6465f4b1a55040f193debd8af6f9df35 P 5fa6e53b96f6474b8cc732d5c9aa2a97: Deleting consensus metadata
I20260923 19:42:06.003764 18226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:05.957157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55182 (local address 127.13.88.193:46399)
0923 19:42:05.957371 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:05.957381 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:05.980060 (+ 22679us) server_negotiation.cc:407] Connection header received
0923 19:42:05.980678 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:05.980688 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:05.980810 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:05.980901 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:05.983236 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.984751 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.989176 (+ 4425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:05.989829 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:05.989952 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:05.996011 (+ 6059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:05.996025 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:05.996046 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:05.996092 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:06.000142 (+ 4050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:06.001065 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:06.001076 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:06.001081 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:06.001262 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:06.001712 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:06.001717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:06.001720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:06.002230 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:06.002535 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:06.003090 (+ 555us) server_negotiation.cc:299] Negotiation successful
0923 19:42:06.003339 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:42:06.004366 17745 catalog_manager.cc:4841] TS 5fa6e53b96f6474b8cc732d5c9aa2a97 (127.13.88.193:46399): tablet 6465f4b1a55040f193debd8af6f9df35 (table test-table [id=84b7b04032b44efbab85d55805104ae4]) successfully deleted
I20260923 19:42:06.005342 17942 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:06.009510 18254 ts_tablet_manager.cc:1918] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:06.009693 18254 log.cc:1196] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/6465f4b1a55040f193debd8af6f9df35
I20260923 19:42:06.010150 18254 ts_tablet_manager.cc:1939] T 6465f4b1a55040f193debd8af6f9df35 P 5a3557d95c1942b581eeb20b9c207b5d: Deleting consensus metadata
I20260923 19:42:06.010960 18252 ts_tablet_manager.cc:1918] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:06.011123 18252 log.cc:1196] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/6465f4b1a55040f193debd8af6f9df35
I20260923 19:42:06.011603 18252 ts_tablet_manager.cc:1939] T 6465f4b1a55040f193debd8af6f9df35 P 905a4d7e6a36415282bc0a3da52158e0: Deleting consensus metadata
I20260923 19:42:06.011633 17743 catalog_manager.cc:4841] TS 5a3557d95c1942b581eeb20b9c207b5d (127.13.88.194:40039): tablet 6465f4b1a55040f193debd8af6f9df35 (table test-table [id=84b7b04032b44efbab85d55805104ae4]) successfully deleted
I20260923 19:42:06.013252 17744 catalog_manager.cc:4841] TS 905a4d7e6a36415282bc0a3da52158e0 (127.13.88.195:46649): tablet 6465f4b1a55040f193debd8af6f9df35 (table test-table [id=84b7b04032b44efbab85d55805104ae4]) successfully deleted
I20260923 19:42:06.099967 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17820
I20260923 19:42:06.117654 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17953
Sep 23 19:42:06 dist-test-slave-xg7f krb5kdc[17715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:42:06.134199 18229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:06.118504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55240 (local address 127.13.88.194:40039)
0923 19:42:06.118668 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:06.118673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:06.118689 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:42:06.118848 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:06.118852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:06.118910 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:06.118993 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:06.120503 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:06.121218 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:06.122982 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:06.123541 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:06.123631 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:06.128637 (+ 5006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:06.128652 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:06.128667 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:06.128699 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:06.131578 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:06.132357 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:06.132364 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:06.132366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:06.132494 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:06.132871 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:06.132874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:06.132876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:06.133215 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:06.133416 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:06.133760 (+ 344us) server_negotiation.cc:299] Negotiation successful
0923 19:42:06.133913 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:42:06.135149 18075 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:06.247711 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17953
I20260923 19:42:06.261180 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 18085
Sep 23 19:42:06 dist-test-slave-xg7f krb5kdc[17715](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:42:06.278571 18227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:06.261959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56924 (local address 127.13.88.195:46649)
0923 19:42:06.262127 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:06.262131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:06.262197 (+ 66us) server_negotiation.cc:407] Connection header received
0923 19:42:06.262405 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:06.262408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:06.262513 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:06.262599 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:06.264343 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:06.265127 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:06.266980 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:06.267541 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:06.267667 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:06.272758 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:06.272768 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:06.272782 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:06.272819 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:06.275797 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:06.276437 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:06.276454 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:06.276456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:06.276607 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:06.277015 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:06.277026 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:06.277029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:06.277405 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:06.277725 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:06.277980 (+ 255us) server_negotiation.cc:299] Negotiation successful
0923 19:42:06.278205 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:06.279251 18207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:06.399644 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 18085
I20260923 19:42:06.418154 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 17728
I20260923 19:42:06.419239 17789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:06.525130 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 17728
2026-09-23T19:42:06Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4080 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-23T19:42:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:06Z Disabled control of system clock
I20260923 19:42:06.589570 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42355
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:39263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:42355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 19:42:06.900094 18263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:06.900365 18263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:06.900539 18263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:06.907459 18263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:06.907596 18263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:06.907660 18263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:06.907775 18263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:06.907851 18263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:06.916790 18263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:42355
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:06.918061 18263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:06.919890 18263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:06.931614 18268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:06.931581 18269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:06.931553 18271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:06.932575 18263 server_base.cc:1034] running on GCE node
I20260923 19:42:06.933308 18263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:06.934613 18263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:06.935828 18263 hybrid_clock.cc:648] HybridClock initialized: now 1790192526935762 us; error 81 us; skew 500 ppm
I20260923 19:42:06.936164 18263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:06.943255 18263 webserver.cc:460] Webserver started at http://127.13.88.254:33795/ using document root <none> and password file <none>
I20260923 19:42:06.943945 18263 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:06.944072 18263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:06.944425 18263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:06.947325 18263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "c9b6c89b3cf34265a69a7916d6241f55"
format_stamp: "Formatted at 2026-09-23 19:42:06 on dist-test-slave-xg7f"
server_key: "58dfac1e1b82d3ad4baa59dafde74c10"
server_key_iv: "1f8dd391bd6c0dea3af756e8d00725ac"
server_key_version: "encryptionkey@0"
I20260923 19:42:06.948119 18263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "c9b6c89b3cf34265a69a7916d6241f55"
format_stamp: "Formatted at 2026-09-23 19:42:06 on dist-test-slave-xg7f"
server_key: "58dfac1e1b82d3ad4baa59dafde74c10"
server_key_iv: "1f8dd391bd6c0dea3af756e8d00725ac"
server_key_version: "encryptionkey@0"
I20260923 19:42:06.952796 18263 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:42:06.955843 18277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:06.957056 18263 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 19:42:06.957221 18263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "c9b6c89b3cf34265a69a7916d6241f55"
format_stamp: "Formatted at 2026-09-23 19:42:06 on dist-test-slave-xg7f"
server_key: "58dfac1e1b82d3ad4baa59dafde74c10"
server_key_iv: "1f8dd391bd6c0dea3af756e8d00725ac"
server_key_version: "encryptionkey@0"
I20260923 19:42:06.957422 18263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:06.962844 18263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:06.963604 18263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:06.963876 18263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:06.981477 18263 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:42355
I20260923 19:42:06.981508 18328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:42355 every 8 connection(s)
I20260923 19:42:06.982695 18263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:06.986088 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 18263
I20260923 19:42:06.986290 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:06.986500 18329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:06.987114 13667 external_mini_cluster.cc:1428] Setting key 72f5863431a8f987618073f0d7cd663a
I20260923 19:42:06.995610 18332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:06.989071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48944 (local address 127.13.88.254:42355)
0923 19:42:06.990076 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:06.990086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:06.990125 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:42:06.992315 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:06.992336 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:06.992728 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:06.993054 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:06.994057 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:06.994063 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:06.994075 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:06.994088 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:06.994146 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:06.994160 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:06.994308 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:06.994434 (+ 126us) server_negotiation.cc:299] Negotiation successful
0923 19:42:06.994674 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":401,"threads_started":1}
I20260923 19:42:06.999254 18329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55: Bootstrap starting.
I20260923 19:42:07.002162 18329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:07.003166 18329 log.cc:824] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:07.005765 18329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55: No bootstrap required, opened a new log
I20260923 19:42:07.012676 18329 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b6c89b3cf34265a69a7916d6241f55" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42355 } }
I20260923 19:42:07.013024 18329 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:07.013126 18329 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9b6c89b3cf34265a69a7916d6241f55, State: Initialized, Role: FOLLOWER
I20260923 19:42:07.013656 18329 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b6c89b3cf34265a69a7916d6241f55" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42355 } }
I20260923 19:42:07.013886 18329 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:07.014026 18329 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:07.014184 18329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:07.016289 18329 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b6c89b3cf34265a69a7916d6241f55" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42355 } }
I20260923 19:42:07.016762 18329 leader_election.cc:302] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9b6c89b3cf34265a69a7916d6241f55; no voters:
I20260923 19:42:07.017313 18329 leader_election.cc:288] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:07.017499 18334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:07.018843 18334 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [term 1 LEADER]: Becoming Leader. State: Replica: c9b6c89b3cf34265a69a7916d6241f55, State: Running, Role: LEADER
I20260923 19:42:07.019408 18334 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b6c89b3cf34265a69a7916d6241f55" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42355 } }
I20260923 19:42:07.019531 18329 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:07.022166 18336 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9b6c89b3cf34265a69a7916d6241f55. Latest consensus state: current_term: 1 leader_uuid: "c9b6c89b3cf34265a69a7916d6241f55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b6c89b3cf34265a69a7916d6241f55" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42355 } } }
I20260923 19:42:07.022198 18335 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9b6c89b3cf34265a69a7916d6241f55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b6c89b3cf34265a69a7916d6241f55" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42355 } } }
I20260923 19:42:07.022521 18336 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:07.022574 18335 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:07.023694 18343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:07.028847 18343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:07.036909 18343 catalog_manager.cc:1347] Generated new cluster ID: 9f7a87209732433fa52b4b321fa75acb
I20260923 19:42:07.037083 18343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:07.053081 18343 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:07.053516 18343 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:07.066650 18343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55: Generated new TSK 0
I20260923 19:42:07.067533 18343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:42:07.078537 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42355
--builtin_ntp_servers=127.13.88.212:39263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 19:42:07.399464 18353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:07.399717 18353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:07.399879 18353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:07.406736 18353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:07.406827 18353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:07.407039 18353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:07.415860 18353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:07.417070 18353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:07.418807 18353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:07.432125 18358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:07.432163 18359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:07.432195 18361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:07.432988 18353 server_base.cc:1034] running on GCE node
I20260923 19:42:07.433554 18353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:07.434384 18353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:07.435606 18353 hybrid_clock.cc:648] HybridClock initialized: now 1790192527435569 us; error 46 us; skew 500 ppm
I20260923 19:42:07.435909 18353 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:07.438076 18353 webserver.cc:460] Webserver started at http://127.13.88.193:33137/ using document root <none> and password file <none>
I20260923 19:42:07.438733 18353 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:07.438866 18353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:07.439251 18353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:07.441955 18353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "fe6c344adef84829a3b369e215a2e176"
format_stamp: "Formatted at 2026-09-23 19:42:07 on dist-test-slave-xg7f"
server_key: "13c1bdd9ce07f7a12dc1a3a9b3f6dbc4"
server_key_iv: "ea874dd84a0ffc6aa5eada3b630261a0"
server_key_version: "encryptionkey@0"
I20260923 19:42:07.442724 18353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "fe6c344adef84829a3b369e215a2e176"
format_stamp: "Formatted at 2026-09-23 19:42:07 on dist-test-slave-xg7f"
server_key: "13c1bdd9ce07f7a12dc1a3a9b3f6dbc4"
server_key_iv: "ea874dd84a0ffc6aa5eada3b630261a0"
server_key_version: "encryptionkey@0"
I20260923 19:42:07.447830 18353 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:42:07.451042 18367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:07.452304 18353 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:07.452477 18353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "fe6c344adef84829a3b369e215a2e176"
format_stamp: "Formatted at 2026-09-23 19:42:07 on dist-test-slave-xg7f"
server_key: "13c1bdd9ce07f7a12dc1a3a9b3f6dbc4"
server_key_iv: "ea874dd84a0ffc6aa5eada3b630261a0"
server_key_version: "encryptionkey@0"
I20260923 19:42:07.452683 18353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:07.458225 18353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:07.458976 18353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:07.459285 18353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:07.460131 18353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:07.461588 18353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:07.461699 18353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:07.461820 18353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:07.461905 18353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:07.493992 18353 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:36211
I20260923 19:42:07.494045 18479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:36211 every 8 connection(s)
I20260923 19:42:07.495527 18353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:07.498193 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 18353
I20260923 19:42:07.498379 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:07.499162 13667 external_mini_cluster.cc:1428] Setting key 39eb97f3e42ddd8b07eb898399dcf1ee
I20260923 19:42:07.501870 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42355
--builtin_ntp_servers=127.13.88.212:39263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260923 19:42:07.504343 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:07.498142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:37325 (local address 127.13.88.254:42355)
0923 19:42:07.498686 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:07.498692 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:07.500065 (+ 1373us) server_negotiation.cc:407] Connection header received
0923 19:42:07.501930 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:07.501938 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:07.502005 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:07.502121 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:07.503496 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:07.503504 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:07.503512 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:07.503534 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:07.503588 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:07.503605 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:07.503725 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:07.503889 (+ 164us) server_negotiation.cc:299] Negotiation successful
0923 19:42:07.503954 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":283,"threads_started":1}
I20260923 19:42:07.505151 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:07.498824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42355 (local address 127.13.88.193:37325)
0923 19:42:07.499905 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:07.499956 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:07.501669 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:07.502354 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:07.502362 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:07.502460 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:07.503194 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:07.503196 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:07.503234 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:07.503320 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:07.503702 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:07.503709 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:07.503715 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:42:07.503925 (+ 210us) client_negotiation.cc:240] Negotiation successful
0923 19:42:07.504114 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":349,"threads_started":1}
I20260923 19:42:07.506688 18480 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42355
I20260923 19:42:07.506975 18480 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:07.507556 18480 heartbeater.cc:511] Master 127.13.88.254:42355 requested a full tablet report, sending...
I20260923 19:42:07.509547 18294 ts_manager.cc:194] Registered new tserver with Master: fe6c344adef84829a3b369e215a2e176 (127.13.88.193:36211)
W20260923 19:42:07.817385 18484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:07.817662 18484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:07.817749 18484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:07.825062 18484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:07.825152 18484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:07.825354 18484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:07.834052 18484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:07.835263 18484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:07.836987 18484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:07.849135 18489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:07.849104 18492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:07.849189 18490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:07.850178 18484 server_base.cc:1034] running on GCE node
I20260923 19:42:07.850682 18484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:07.851542 18484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:07.852731 18484 hybrid_clock.cc:648] HybridClock initialized: now 1790192527852697 us; error 34 us; skew 500 ppm
I20260923 19:42:07.853041 18484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:07.855016 18484 webserver.cc:460] Webserver started at http://127.13.88.194:38555/ using document root <none> and password file <none>
I20260923 19:42:07.855744 18484 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:07.855950 18484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:07.856274 18484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:07.858963 18484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "bdaf034e2d204d7c8ec287d52a24df96"
format_stamp: "Formatted at 2026-09-23 19:42:07 on dist-test-slave-xg7f"
server_key: "2c11e98bc4a506bf83fb96f320556b2c"
server_key_iv: "e5d9085dbfd54d68aed7f48aa548dca3"
server_key_version: "encryptionkey@0"
I20260923 19:42:07.859798 18484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "bdaf034e2d204d7c8ec287d52a24df96"
format_stamp: "Formatted at 2026-09-23 19:42:07 on dist-test-slave-xg7f"
server_key: "2c11e98bc4a506bf83fb96f320556b2c"
server_key_iv: "e5d9085dbfd54d68aed7f48aa548dca3"
server_key_version: "encryptionkey@0"
I20260923 19:42:07.864821 18484 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:42:07.868188 18498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:07.869421 18484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:07.869594 18484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "bdaf034e2d204d7c8ec287d52a24df96"
format_stamp: "Formatted at 2026-09-23 19:42:07 on dist-test-slave-xg7f"
server_key: "2c11e98bc4a506bf83fb96f320556b2c"
server_key_iv: "e5d9085dbfd54d68aed7f48aa548dca3"
server_key_version: "encryptionkey@0"
I20260923 19:42:07.869798 18484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:07.875386 18484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:07.876108 18484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:07.876360 18484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:07.877200 18484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:07.878505 18484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:07.878620 18484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:07.878752 18484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:07.878839 18484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:07.911041 18484 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:42033
I20260923 19:42:07.911208 18610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:42033 every 8 connection(s)
I20260923 19:42:07.912376 18484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:07.920341 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:07.915037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:43915 (local address 127.13.88.254:42355)
0923 19:42:07.915262 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:07.915268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:07.916664 (+ 1396us) server_negotiation.cc:407] Connection header received
0923 19:42:07.918230 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:07.918234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:07.918285 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:07.918370 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:07.919686 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:07.919690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:07.919693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:07.919726 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:07.919765 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:07.919777 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:07.919867 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:07.920036 (+ 169us) server_negotiation.cc:299] Negotiation successful
0923 19:42:07.920084 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:42:07.921253 18613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:07.915658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42355 (local address 127.13.88.194:43915)
0923 19:42:07.916519 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:07.916558 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:07.918002 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:07.918571 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:07.918578 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:07.918665 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:07.919368 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:07.919370 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:07.919445 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:07.919543 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:07.919862 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:07.919869 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:07.919875 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:42:07.920087 (+ 212us) client_negotiation.cc:240] Negotiation successful
0923 19:42:07.920273 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":248,"threads_started":1}
I20260923 19:42:07.921521 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 18484
I20260923 19:42:07.921703 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:07.922242 13667 external_mini_cluster.cc:1428] Setting key 063bc3a1ee8f2c95a9d1bcd90a7f4106
I20260923 19:42:07.922683 18611 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42355
I20260923 19:42:07.922969 18611 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:07.923658 18611 heartbeater.cc:511] Master 127.13.88.254:42355 requested a full tablet report, sending...
I20260923 19:42:07.925028 18294 ts_manager.cc:194] Registered new tserver with Master: bdaf034e2d204d7c8ec287d52a24df96 (127.13.88.194:42033)
I20260923 19:42:07.925210 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42355
--builtin_ntp_servers=127.13.88.212:39263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 19:42:08.238358 18614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:08.238605 18614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:08.238687 18614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:08.245534 18614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:08.245623 18614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:08.245726 18614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:08.254213 18614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42355
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:08.255394 18614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:08.257228 18614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:08.269562 18619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:08.269601 18622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:08.269637 18620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:08.270313 18614 server_base.cc:1034] running on GCE node
I20260923 19:42:08.270833 18614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:08.271746 18614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:08.272946 18614 hybrid_clock.cc:648] HybridClock initialized: now 1790192528272917 us; error 32 us; skew 500 ppm
I20260923 19:42:08.273252 18614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:08.275425 18614 webserver.cc:460] Webserver started at http://127.13.88.195:41765/ using document root <none> and password file <none>
I20260923 19:42:08.276070 18614 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:08.276155 18614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:08.276410 18614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:08.278913 18614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "a92ab396993347d5b2bed2b3b8622a3a"
format_stamp: "Formatted at 2026-09-23 19:42:08 on dist-test-slave-xg7f"
server_key: "65b1e4de35bafcc08a23ff297b6d5dfd"
server_key_iv: "0b2d5c2b1fe0996ff3780d9f6533c979"
server_key_version: "encryptionkey@0"
I20260923 19:42:08.279659 18614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "a92ab396993347d5b2bed2b3b8622a3a"
format_stamp: "Formatted at 2026-09-23 19:42:08 on dist-test-slave-xg7f"
server_key: "65b1e4de35bafcc08a23ff297b6d5dfd"
server_key_iv: "0b2d5c2b1fe0996ff3780d9f6533c979"
server_key_version: "encryptionkey@0"
I20260923 19:42:08.284263 18614 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:42:08.287303 18628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:08.288467 18614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 19:42:08.288610 18614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "a92ab396993347d5b2bed2b3b8622a3a"
format_stamp: "Formatted at 2026-09-23 19:42:08 on dist-test-slave-xg7f"
server_key: "65b1e4de35bafcc08a23ff297b6d5dfd"
server_key_iv: "0b2d5c2b1fe0996ff3780d9f6533c979"
server_key_version: "encryptionkey@0"
I20260923 19:42:08.288810 18614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:08.294047 18614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:08.294739 18614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:08.294992 18614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:08.295846 18614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:08.297106 18614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:08.297235 18614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:08.297348 18614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:08.297434 18614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:08.328542 18614 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:34773
I20260923 19:42:08.328572 18740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:34773 every 8 connection(s)
I20260923 19:42:08.329785 18614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:08.332779 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 18614
I20260923 19:42:08.332935 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:08.333411 13667 external_mini_cluster.cc:1428] Setting key 4f9bcef41f90d6eaa009d503514777d7
I20260923 19:42:08.337749 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.332184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:54293 (local address 127.13.88.254:42355)
0923 19:42:08.332363 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.332367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.333871 (+ 1504us) server_negotiation.cc:407] Connection header received
0923 19:42:08.335684 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.335689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.335754 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.335868 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.337031 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.337036 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.337041 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.337058 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.337097 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.337108 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.337226 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.337398 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.337477 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:42:08.338596 18743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.332657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42355 (local address 127.13.88.195:54293)
0923 19:42:08.333681 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.333726 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:08.335404 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:08.336090 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:08.336097 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:08.336181 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:08.336759 (+ 578us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:08.336761 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:08.336792 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:08.336862 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:08.337194 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:08.337205 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:08.337214 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 19:42:08.337477 (+ 263us) client_negotiation.cc:240] Negotiation successful
0923 19:42:08.337701 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":376,"threads_started":1}
I20260923 19:42:08.339840 18741 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42355
I20260923 19:42:08.340107 18741 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:08.340668 18741 heartbeater.cc:511] Master 127.13.88.254:42355 requested a full tablet report, sending...
I20260923 19:42:08.341862 18294 ts_manager.cc:194] Registered new tserver with Master: a92ab396993347d5b2bed2b3b8622a3a (127.13.88.195:34773)
I20260923 19:42:08.348119 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:42:08.354467 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.352314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48952 (local address 127.13.88.254:42355)
0923 19:42:08.352466 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.352470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.353010 (+ 540us) server_negotiation.cc:407] Connection header received
0923 19:42:08.353155 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.353158 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.353201 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.353273 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.354082 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.354085 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.354088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.354099 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.354122 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.354132 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.354211 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.354246 (+ 35us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.354283 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:42:08.358263 18294 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:42:08.365206 18294 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:08.383538 18755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.377139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52550 (local address 127.13.88.194:42033)
0923 19:42:08.380286 (+ 3147us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.380292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.380314 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:42:08.380363 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.380368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.380590 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.380753 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.382046 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.382057 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.382072 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.382100 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.382160 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.382185 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.382996 (+ 811us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.383066 (+ 70us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.383180 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3005,"thread_start_us":2891,"threads_started":1}
I20260923 19:42:08.383845 18754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.376808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34234)
0923 19:42:08.377708 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.377724 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:08.377818 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:08.381786 (+ 3968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:08.381790 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:08.381811 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:08.382406 (+ 595us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:08.382411 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:08.382427 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:08.382473 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:08.382992 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:08.383000 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:08.383007 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 19:42:08.383219 (+ 212us) client_negotiation.cc:240] Negotiation successful
0923 19:42:08.383285 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"thread_start_us":702,"threads_started":1}
I20260923 19:42:08.384560 18756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.377379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34234 (local address 127.13.88.193:36211)
0923 19:42:08.378234 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.378246 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.378280 (+ 34us) server_negotiation.cc:407] Connection header received
0923 19:42:08.378359 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.378369 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.378672 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.378839 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.382624 (+ 3785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.382637 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.382654 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.382679 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.382751 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.382781 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.382928 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.384218 (+ 1290us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.384320 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":866,"threads_started":1}
I20260923 19:42:08.384049 18753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.376579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:42033 (local address 127.0.0.1:52550)
0923 19:42:08.377510 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.377556 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:08.377704 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:08.380766 (+ 3062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:08.380772 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:08.380875 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:08.381730 (+ 855us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:08.381733 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:08.381759 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:08.381844 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:08.382306 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:08.382318 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:08.382328 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 19:42:08.382494 (+ 166us) client_negotiation.cc:240] Negotiation successful
0923 19:42:08.382580 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":732,"threads_started":1}
I20260923 19:42:08.386685 18758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.378435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53320 (local address 127.13.88.195:34773)
0923 19:42:08.382822 (+ 4387us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.382829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.384483 (+ 1654us) server_negotiation.cc:407] Connection header received
0923 19:42:08.384618 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.384625 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.384765 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.384906 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.385912 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.385919 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.385930 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.385946 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.385997 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.386013 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.386178 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.386241 (+ 63us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.386329 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4233,"thread_start_us":3826,"threads_started":1}
I20260923 19:42:08.386942 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.378133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:34773 (local address 127.0.0.1:53320)
0923 19:42:08.384370 (+ 6237us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.384384 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:08.384502 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:08.384961 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:08.384968 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:08.384990 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:08.385691 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:08.385694 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:08.385709 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:08.385752 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:08.386128 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:08.386133 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:08.386138 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:42:08.386267 (+ 129us) client_negotiation.cc:240] Negotiation successful
0923 19:42:08.386331 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6156,"thread_start_us":6060,"threads_started":1}
I20260923 19:42:08.388757 18546 tablet_service.cc:1467] Processing CreateTablet for tablet 79106b3690e646238738579b1b00b707 (DEFAULT_TABLE table=test-table [id=37706093d47c47c48900937b89890418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:08.388757 18415 tablet_service.cc:1467] Processing CreateTablet for tablet 79106b3690e646238738579b1b00b707 (DEFAULT_TABLE table=test-table [id=37706093d47c47c48900937b89890418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:08.389878 18546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79106b3690e646238738579b1b00b707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:08.389883 18415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79106b3690e646238738579b1b00b707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:08.394773 18676 tablet_service.cc:1467] Processing CreateTablet for tablet 79106b3690e646238738579b1b00b707 (DEFAULT_TABLE table=test-table [id=37706093d47c47c48900937b89890418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:08.396158 18676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79106b3690e646238738579b1b00b707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:08.401042 18759 tablet_bootstrap.cc:492] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Bootstrap starting.
I20260923 19:42:08.403469 18760 tablet_bootstrap.cc:492] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: Bootstrap starting.
I20260923 19:42:08.404562 18759 tablet_bootstrap.cc:654] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:08.405840 18759 log.cc:824] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:08.406919 18760 tablet_bootstrap.cc:654] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:08.408200 18760 log.cc:824] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:08.409159 18759 tablet_bootstrap.cc:492] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: No bootstrap required, opened a new log
I20260923 19:42:08.409487 18759 ts_tablet_manager.cc:1397] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260923 19:42:08.411157 18760 tablet_bootstrap.cc:492] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: No bootstrap required, opened a new log
I20260923 19:42:08.411268 18763 tablet_bootstrap.cc:492] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Bootstrap starting.
I20260923 19:42:08.411403 18760 ts_tablet_manager.cc:1397] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:42:08.414062 18763 tablet_bootstrap.cc:654] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:08.415355 18763 log.cc:824] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:08.417677 18763 tablet_bootstrap.cc:492] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: No bootstrap required, opened a new log
I20260923 19:42:08.417927 18763 ts_tablet_manager.cc:1397] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260923 19:42:08.419914 18759 raft_consensus.cc:348] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.420351 18759 raft_consensus.cc:374] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:08.420451 18759 raft_consensus.cc:729] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdaf034e2d204d7c8ec287d52a24df96, State: Initialized, Role: FOLLOWER
I20260923 19:42:08.421043 18759 consensus_queue.cc:260] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.421547 18760 raft_consensus.cc:348] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.422019 18760 raft_consensus.cc:374] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:08.422150 18760 raft_consensus.cc:729] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6c344adef84829a3b369e215a2e176, State: Initialized, Role: FOLLOWER
I20260923 19:42:08.422158 18611 heartbeater.cc:503] Master 127.13.88.254:42355 was elected leader, sending a full tablet report...
I20260923 19:42:08.422926 18759 ts_tablet_manager.cc:1428] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260923 19:42:08.422747 18760 consensus_queue.cc:260] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.423931 18480 heartbeater.cc:503] Master 127.13.88.254:42355 was elected leader, sending a full tablet report...
I20260923 19:42:08.424499 18760 ts_tablet_manager.cc:1428] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260923 19:42:08.427239 18763 raft_consensus.cc:348] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.427757 18763 raft_consensus.cc:374] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:08.427934 18763 raft_consensus.cc:729] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92ab396993347d5b2bed2b3b8622a3a, State: Initialized, Role: FOLLOWER
I20260923 19:42:08.428567 18763 consensus_queue.cc:260] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.429566 18741 heartbeater.cc:503] Master 127.13.88.254:42355 was elected leader, sending a full tablet report...
I20260923 19:42:08.429921 18763 ts_tablet_manager.cc:1428] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Time spent starting tablet: real 0.012s user 0.003s sys 0.009s
W20260923 19:42:08.497802 18481 tablet.cc:2369] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:42:08.510651 18765 raft_consensus.cc:482] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:08.510926 18765 raft_consensus.cc:504] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.512401 18765 leader_election.cc:288] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6c344adef84829a3b369e215a2e176 (127.13.88.193:36211), a92ab396993347d5b2bed2b3b8622a3a (127.13.88.195:34773)
I20260923 19:42:08.515618 18756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.512836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:52219 (local address 127.13.88.193:36211)
0923 19:42:08.513094 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.513100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.513402 (+ 302us) server_negotiation.cc:407] Connection header received
0923 19:42:08.513630 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.513639 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.513725 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.513826 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.514988 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.514992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.514995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.515008 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.515035 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.515046 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.515193 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.515270 (+ 77us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.515327 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:42:08.515817 18768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.512745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.13.88.194:52219)
0923 19:42:08.513300 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.513315 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:08.513471 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:08.513958 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:08.513963 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:08.513988 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:08.514774 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:08.514776 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:08.514789 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:08.514824 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:08.515169 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:08.515173 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:08.515178 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:42:08.515277 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 19:42:08.515329 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":290,"threads_started":1}
I20260923 19:42:08.516006 18758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.513586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:39771 (local address 127.13.88.195:34773)
0923 19:42:08.513828 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.513834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.514172 (+ 338us) server_negotiation.cc:407] Connection header received
0923 19:42:08.514305 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.514308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.514349 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.514420 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.515394 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.515399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.515404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.515421 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.515461 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.515473 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.515596 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.515685 (+ 89us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.515747 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:42:08.516577 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.513459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:34773 (local address 127.13.88.194:39771)
0923 19:42:08.514053 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.514075 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:08.514201 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:08.514483 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:08.514488 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:08.514510 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:08.515184 (+ 674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:08.515192 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:08.515205 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:08.515238 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:08.515563 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:08.515567 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:08.515572 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:42:08.515731 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 19:42:08.515777 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":286,"threads_started":1}
I20260923 19:42:08.516855 18435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79106b3690e646238738579b1b00b707" candidate_uuid: "bdaf034e2d204d7c8ec287d52a24df96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6c344adef84829a3b369e215a2e176" is_pre_election: true
I20260923 19:42:08.517300 18435 raft_consensus.cc:2454] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdaf034e2d204d7c8ec287d52a24df96 in term 0.
I20260923 19:42:08.517418 18696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79106b3690e646238738579b1b00b707" candidate_uuid: "bdaf034e2d204d7c8ec287d52a24df96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92ab396993347d5b2bed2b3b8622a3a" is_pre_election: true
I20260923 19:42:08.517943 18696 raft_consensus.cc:2454] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdaf034e2d204d7c8ec287d52a24df96 in term 0.
I20260923 19:42:08.517957 18499 leader_election.cc:302] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdaf034e2d204d7c8ec287d52a24df96, fe6c344adef84829a3b369e215a2e176; no voters:
I20260923 19:42:08.518294 18765 raft_consensus.cc:2781] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:08.518440 18765 raft_consensus.cc:482] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:08.518546 18765 raft_consensus.cc:3037] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:08.520867 18765 raft_consensus.cc:504] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.521392 18765 leader_election.cc:288] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [CANDIDATE]: Term 1 election: Requested vote from peers fe6c344adef84829a3b369e215a2e176 (127.13.88.193:36211), a92ab396993347d5b2bed2b3b8622a3a (127.13.88.195:34773)
I20260923 19:42:08.521721 18435 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79106b3690e646238738579b1b00b707" candidate_uuid: "bdaf034e2d204d7c8ec287d52a24df96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6c344adef84829a3b369e215a2e176"
I20260923 19:42:08.521899 18435 raft_consensus.cc:3037] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:08.521835 18696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79106b3690e646238738579b1b00b707" candidate_uuid: "bdaf034e2d204d7c8ec287d52a24df96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a92ab396993347d5b2bed2b3b8622a3a"
I20260923 19:42:08.522056 18696 raft_consensus.cc:3037] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:08.524078 18435 raft_consensus.cc:2454] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdaf034e2d204d7c8ec287d52a24df96 in term 1.
I20260923 19:42:08.524363 18696 raft_consensus.cc:2454] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdaf034e2d204d7c8ec287d52a24df96 in term 1.
I20260923 19:42:08.524461 18499 leader_election.cc:302] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdaf034e2d204d7c8ec287d52a24df96, fe6c344adef84829a3b369e215a2e176; no voters:
I20260923 19:42:08.524731 18765 raft_consensus.cc:2781] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:08.525130 18765 raft_consensus.cc:686] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 1 LEADER]: Becoming Leader. State: Replica: bdaf034e2d204d7c8ec287d52a24df96, State: Running, Role: LEADER
I20260923 19:42:08.525583 18765 consensus_queue.cc:237] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } }
I20260923 19:42:08.530036 18294 catalog_manager.cc:5495] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdaf034e2d204d7c8ec287d52a24df96 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "bdaf034e2d204d7c8ec287d52a24df96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdaf034e2d204d7c8ec287d52a24df96" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 } health_report { overall_health: UNKNOWN } } }
I20260923 19:42:08.573558 18755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.571574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52562 (local address 127.13.88.194:42033)
0923 19:42:08.571769 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.571776 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.571808 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:42:08.571904 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.571908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.571989 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.572098 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.572908 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.572914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.572919 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.572945 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.572975 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.572986 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.573120 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.573220 (+ 100us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.573276 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260923 19:42:08.581410 18742 tablet.cc:2369] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:42:08.582319 18696 raft_consensus.cc:1261] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 1 FOLLOWER]: Refusing update from remote peer bdaf034e2d204d7c8ec287d52a24df96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:08.582319 18435 raft_consensus.cc:1261] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 1 FOLLOWER]: Refusing update from remote peer bdaf034e2d204d7c8ec287d52a24df96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:08.583252 18770 consensus_queue.cc:1035] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a92ab396993347d5b2bed2b3b8622a3a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:08.583667 18765 consensus_queue.cc:1035] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6c344adef84829a3b369e215a2e176" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 36211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:08.608939 18775 mvcc.cc:205] Tried to move back new op lower bound from 7332628597062758400 to 7332628596844486656. Current Snapshot: MvccSnapshot[applied={T|T < 7332628597062758400}]
I20260923 19:42:08.614599 18294 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:08.614962 18294 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:08.618221 18294 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9b6c89b3cf34265a69a7916d6241f55: Sending DeleteTablet for 3 replicas of tablet 79106b3690e646238738579b1b00b707
I20260923 19:42:08.619262 18546 tablet_service.cc:1514] Processing DeleteTablet for tablet 79106b3690e646238738579b1b00b707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:08 UTC) from {username='slave'} at 127.0.0.1:52550
I20260923 19:42:08.619761 18415 tablet_service.cc:1514] Processing DeleteTablet for tablet 79106b3690e646238738579b1b00b707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:08 UTC) from {username='slave'} at 127.0.0.1:34234
I20260923 19:42:08.619822 18676 tablet_service.cc:1514] Processing DeleteTablet for tablet 79106b3690e646238738579b1b00b707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:08 UTC) from {username='slave'} at 127.0.0.1:53320
I20260923 19:42:08.621791 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 18353
I20260923 19:42:08.628908 18785 tablet_replica.cc:330] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: stopping tablet replica
I20260923 19:42:08.629460 18785 raft_consensus.cc:2229] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:08.630051 18785 raft_consensus.cc:2258] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:08.630565 18784 tablet_replica.cc:330] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: stopping tablet replica
I20260923 19:42:08.630960 18784 raft_consensus.cc:2229] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:08.631429 18784 raft_consensus.cc:2258] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:08.632251 18783 tablet_replica.cc:330] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: stopping tablet replica
I20260923 19:42:08.632412 18785 ts_tablet_manager.cc:1905] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:08.632647 18783 raft_consensus.cc:2229] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:08.633262 18783 raft_consensus.cc:2258] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:08.635304 18784 ts_tablet_manager.cc:1905] T 79106b3690e646238738579b1b00b707 P fe6c344adef84829a3b369e215a2e176: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:08.635401 18783 ts_tablet_manager.cc:1905] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:08.639325 18785 ts_tablet_manager.cc:1918] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:08.639536 18785 log.cc:1196] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/79106b3690e646238738579b1b00b707
I20260923 19:42:08.640174 18785 ts_tablet_manager.cc:1939] T 79106b3690e646238738579b1b00b707 P a92ab396993347d5b2bed2b3b8622a3a: Deleting consensus metadata
I20260923 19:42:08.642011 18278 catalog_manager.cc:4841] TS a92ab396993347d5b2bed2b3b8622a3a (127.13.88.195:34773): tablet 79106b3690e646238738579b1b00b707 (table test-table [id=37706093d47c47c48900937b89890418]) successfully deleted
I20260923 19:42:08.642197 18756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.623521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34244 (local address 127.13.88.193:36211)
0923 19:42:08.623733 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.623742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.639881 (+ 16139us) server_negotiation.cc:407] Connection header received
0923 19:42:08.640106 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.640111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.640215 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.640305 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.641437 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.641443 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.641448 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.641466 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.641503 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.641527 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.641620 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.641847 (+ 227us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.641911 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:08.642398 18783 ts_tablet_manager.cc:1918] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:08.642608 18783 log.cc:1196] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/79106b3690e646238738579b1b00b707
I20260923 19:42:08.643188 18783 ts_tablet_manager.cc:1939] T 79106b3690e646238738579b1b00b707 P bdaf034e2d204d7c8ec287d52a24df96: Deleting consensus metadata
I20260923 19:42:08.643358 18475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:08.645105 18279 catalog_manager.cc:4841] TS bdaf034e2d204d7c8ec287d52a24df96 (127.13.88.194:42033): tablet 79106b3690e646238738579b1b00b707 (table test-table [id=37706093d47c47c48900937b89890418]) successfully deleted
I20260923 19:42:08.729636 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 18353
W20260923 19:42:08.754448 18278 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.88.193:36211 (error 108)
I20260923 19:42:08.755208 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 18484
I20260923 19:42:08.756655 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.756113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34256)
0923 19:42:08.756337 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.756489 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260923 19:42:08.756978 18278 catalog_manager.cc:4584] TS fe6c344adef84829a3b369e215a2e176 (127.13.88.193:36211): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 79106b3690e646238738579b1b00b707: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
I20260923 19:42:08.758265 18755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.756003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.13.88.194:42033)
0923 19:42:08.756193 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.756199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.756283 (+ 84us) server_negotiation.cc:407] Connection header received
0923 19:42:08.756511 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.756520 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.756581 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.756691 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.757630 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.757634 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.757637 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.757651 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.757680 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.757691 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.757794 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.757915 (+ 121us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.757961 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:08.758908 18606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:08.810644 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.810189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34266)
0923 19:42:08.810397 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.810488 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260923 19:42:08.811699 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.811342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34280)
0923 19:42:08.811513 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.811589 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 19:42:08.864984 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 18484
I20260923 19:42:08.872357 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.871758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34284)
0923 19:42:08.872023 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.872139 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260923 19:42:08.873476 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.873020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34294)
0923 19:42:08.873211 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.873305 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 19:42:08.884305 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 18614
I20260923 19:42:08.886958 18758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.885064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53336 (local address 127.13.88.195:34773)
0923 19:42:08.885272 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:08.885280 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:08.885305 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:42:08.885369 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:08.885372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:08.885446 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:08.885525 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:08.886351 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:08.886355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:08.886358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:08.886373 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:08.886403 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:08.886414 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:08.886510 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:08.886589 (+ 79us) server_negotiation.cc:299] Negotiation successful
0923 19:42:08.886644 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:42:08.887645 18736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:08.954214 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.953663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34306)
0923 19:42:08.953903 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.954038 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260923 19:42:08.955364 18757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:08.954891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:36211 (local address 127.0.0.1:34310)
0923 19:42:08.955136 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:08.955219 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:36211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260923 19:42:08.975721 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 18614
I20260923 19:42:08.993832 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 18263
I20260923 19:42:08.995723 18324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:09.115343 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 18263
2026-09-23T19:42:09Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2589 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260923 19:42:09.155630 13667 mini_oidc.cc:152] Starting JWKS server
I20260923 19:42:09.158079 13667 webserver.cc:460] Webserver started at https://127.0.0.1:34447/ using document root <none> and password file <none>
I20260923 19:42:09.158370 13667 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 19:42:09.158946 13667 webserver.cc:460] Webserver started at http://127.0.0.1:39341/ using document root <none> and password file <none>
2026-09-23T19:42:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:09Z Disabled control of system clock
I20260923 19:42:09.184087 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:40765
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:37765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:40765
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34447/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/testchainca.cert with env {}
W20260923 19:42:09.492808 18797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:09.493062 18797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:09.493147 18797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:09.500191 18797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:09.500284 18797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:09.500319 18797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:09.500371 18797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:09.500413 18797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:42:09.500469 18797 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:42:09.500507 18797 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34447/jwks.json
I20260923 19:42:09.510039 18797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:37765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:40765
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:40765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34447/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:09.511291 18797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:09.512552 18797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:09.523765 18802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:09.523721 18803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:09.523933 18805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:09.524762 18797 server_base.cc:1034] running on GCE node
I20260923 19:42:09.525405 18797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:09.526688 18797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:09.527920 18797 hybrid_clock.cc:648] HybridClock initialized: now 1790192529527876 us; error 46 us; skew 500 ppm
I20260923 19:42:09.528254 18797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:09.530401 18797 webserver.cc:460] Webserver started at http://127.13.88.254:45339/ using document root <none> and password file <none>
I20260923 19:42:09.531044 18797 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:09.531198 18797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:09.531497 18797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:09.534188 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "e1e25996b19f4ee9ba7a012776c9925f"
format_stamp: "Formatted at 2026-09-23 19:42:09 on dist-test-slave-xg7f"
server_key: "9fb1a138010dcab2cb37c6f0e1b6400d"
server_key_iv: "5bf7cc517c18bff5aa4a497bc36c84db"
server_key_version: "encryptionkey@0"
I20260923 19:42:09.534935 18797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "e1e25996b19f4ee9ba7a012776c9925f"
format_stamp: "Formatted at 2026-09-23 19:42:09 on dist-test-slave-xg7f"
server_key: "9fb1a138010dcab2cb37c6f0e1b6400d"
server_key_iv: "5bf7cc517c18bff5aa4a497bc36c84db"
server_key_version: "encryptionkey@0"
I20260923 19:42:09.539690 18797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:42:09.542819 18811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:09.544160 18797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:09.544340 18797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "e1e25996b19f4ee9ba7a012776c9925f"
format_stamp: "Formatted at 2026-09-23 19:42:09 on dist-test-slave-xg7f"
server_key: "9fb1a138010dcab2cb37c6f0e1b6400d"
server_key_iv: "5bf7cc517c18bff5aa4a497bc36c84db"
server_key_version: "encryptionkey@0"
I20260923 19:42:09.544543 18797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:09.559422 18797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:09.560148 18797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:09.560470 18797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:09.577859 18797 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:40765
I20260923 19:42:09.577878 18862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:40765 every 8 connection(s)
I20260923 19:42:09.579254 18797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:09.580338 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 18797
I20260923 19:42:09.580574 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:09.581171 13667 external_mini_cluster.cc:1428] Setting key b59b8b122b27e098e11decdacb9c6a27
I20260923 19:42:09.583606 18863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:09.596457 18866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:09.583063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39260 (local address 127.13.88.254:40765)
0923 19:42:09.584198 (+ 1135us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:09.584212 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:09.584260 (+ 48us) server_negotiation.cc:407] Connection header received
0923 19:42:09.586416 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:09.586443 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:09.587060 (+ 617us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:09.587520 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:09.588073 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:09.590102 (+ 2029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:09.591465 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:09.592445 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:09.592616 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:09.593689 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:09.593703 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:09.593720 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:09.594462 (+ 742us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:09.594560 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:09.594590 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:09.594707 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:09.594865 (+ 158us) server_negotiation.cc:299] Negotiation successful
0923 19:42:09.595227 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":325,"threads_started":1}
I20260923 19:42:09.597616 18863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f: Bootstrap starting.
I20260923 19:42:09.600116 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:42:09.601150 18863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:09.602346 18863 log.cc:824] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:09.605325 18863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f: No bootstrap required, opened a new log
I20260923 19:42:09.612481 18863 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e25996b19f4ee9ba7a012776c9925f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 40765 } }
I20260923 19:42:09.612830 18863 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:09.612906 18863 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e25996b19f4ee9ba7a012776c9925f, State: Initialized, Role: FOLLOWER
I20260923 19:42:09.613377 18863 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e25996b19f4ee9ba7a012776c9925f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 40765 } }
I20260923 19:42:09.613566 18863 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:09.613684 18863 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:09.613838 18863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:09.616257 18863 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e25996b19f4ee9ba7a012776c9925f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 40765 } }
I20260923 19:42:09.616683 18863 leader_election.cc:302] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1e25996b19f4ee9ba7a012776c9925f; no voters:
I20260923 19:42:09.617182 18863 leader_election.cc:288] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:09.617336 18868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:09.618019 18868 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [term 1 LEADER]: Becoming Leader. State: Replica: e1e25996b19f4ee9ba7a012776c9925f, State: Running, Role: LEADER
I20260923 19:42:09.618513 18868 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e25996b19f4ee9ba7a012776c9925f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 40765 } }
I20260923 19:42:09.619249 18863 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:09.621572 18870 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1e25996b19f4ee9ba7a012776c9925f. Latest consensus state: current_term: 1 leader_uuid: "e1e25996b19f4ee9ba7a012776c9925f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e25996b19f4ee9ba7a012776c9925f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 40765 } } }
I20260923 19:42:09.621614 18869 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1e25996b19f4ee9ba7a012776c9925f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1e25996b19f4ee9ba7a012776c9925f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 40765 } } }
I20260923 19:42:09.622004 18869 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:09.622474 18870 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:09.623996 18876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:09.628988 18876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:09.637732 18876 catalog_manager.cc:1347] Generated new cluster ID: 620f0de57ec7476aaedd770287c1f672
I20260923 19:42:09.637887 18876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:09.663782 18876 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:09.665864 18876 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:09.678036 18876 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1e25996b19f4ee9ba7a012776c9925f: Generated new TSK 0
I20260923 19:42:09.678845 18876 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 19:42:09.728480 18893 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260923 19:42:09.728644 18893 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 19:42:09.729353 18866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:09.701386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39272 (local address 127.13.88.254:40765)
0923 19:42:09.701643 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:09.701649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:09.702060 (+ 411us) server_negotiation.cc:407] Connection header received
0923 19:42:09.702362 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:09.702366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:09.702430 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:09.702545 (+ 115us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:42:09.703202 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:09.703899 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:09.705907 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:09.706346 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:09.706434 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:09.707020 (+ 586us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:42:09.728855 (+ 21835us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 19:42:09.729125 (+ 270us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39272: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":86}
W20260923 19:42:09.729481 18866 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39272: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260923 19:42:09.731241 18892 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:09.701269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:40765 (local address 127.0.0.1:39272)
0923 19:42:09.701952 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:09.701972 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:09.702157 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:09.702608 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:09.702614 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:09.702629 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:42:09.703035 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:09.703047 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:09.704041 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:09.704047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:09.705772 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:09.705786 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:09.706501 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:09.706507 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:09.706694 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:09.706780 (+ 86us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:42:09.729125 (+ 22345us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 19:42:09.729475 (+ 350us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.88.254:40765: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":345,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.13.88.254:40765: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34447/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260923 19:42:09.732728 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 18797
I20260923 19:42:09.733971 18858 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:09.826357 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 18797
2026-09-23T19:42:09Z chronyd exiting
I20260923 19:42:09.876231 13667 test_util.cc:175] -----------------------------------------------
I20260923 19:42:09.876395 13667 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790192489293654-13667-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (725 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260923 19:42:09.880133 13667 mini_oidc.cc:152] Starting JWKS server
I20260923 19:42:09.881880 13667 webserver.cc:460] Webserver started at https://127.0.0.1:34165/ using document root <none> and password file <none>
I20260923 19:42:09.882122 13667 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 19:42:09.882747 13667 webserver.cc:460] Webserver started at http://127.0.0.1:33215/ using document root <none> and password file <none>
2026-09-23T19:42:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:09Z Disabled control of system clock
I20260923 19:42:09.906490 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:37739
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:46549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:37739
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34165/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/testchainca.cert with env {}
W20260923 19:42:10.214378 18900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:10.214653 18900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:10.214747 18900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:10.221647 18900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:10.221735 18900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:10.221788 18900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:10.221850 18900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:10.221889 18900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:42:10.221947 18900 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:42:10.221980 18900 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34165/jwks.json
I20260923 19:42:10.231163 18900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:46549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:37739
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:37739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34165/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:10.232333 18900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:10.233525 18900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:10.244930 18905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:10.244956 18908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:10.244828 18906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:10.245898 18900 server_base.cc:1034] running on GCE node
I20260923 19:42:10.246591 18900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:10.247973 18900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:10.249208 18900 hybrid_clock.cc:648] HybridClock initialized: now 1790192530249166 us; error 58 us; skew 500 ppm
I20260923 19:42:10.249567 18900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:10.251861 18900 webserver.cc:460] Webserver started at http://127.13.88.254:41675/ using document root <none> and password file <none>
I20260923 19:42:10.252528 18900 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:10.252658 18900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:10.252975 18900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:10.255817 18900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "ac29b86332db46289d896947e8f47522"
format_stamp: "Formatted at 2026-09-23 19:42:10 on dist-test-slave-xg7f"
server_key: "1d5b12bb88ef50a284dd082a91c677a1"
server_key_iv: "049a74c4d853c5923accdf1f319ec2ea"
server_key_version: "encryptionkey@0"
I20260923 19:42:10.256633 18900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "ac29b86332db46289d896947e8f47522"
format_stamp: "Formatted at 2026-09-23 19:42:10 on dist-test-slave-xg7f"
server_key: "1d5b12bb88ef50a284dd082a91c677a1"
server_key_iv: "049a74c4d853c5923accdf1f319ec2ea"
server_key_version: "encryptionkey@0"
I20260923 19:42:10.261711 18900 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:42:10.265202 18914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:10.266549 18900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:42:10.266737 18900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "ac29b86332db46289d896947e8f47522"
format_stamp: "Formatted at 2026-09-23 19:42:10 on dist-test-slave-xg7f"
server_key: "1d5b12bb88ef50a284dd082a91c677a1"
server_key_iv: "049a74c4d853c5923accdf1f319ec2ea"
server_key_version: "encryptionkey@0"
I20260923 19:42:10.266970 18900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:10.284509 18900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:10.285370 18900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:10.285692 18900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:10.304298 18900 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:37739
I20260923 19:42:10.304322 18965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:37739 every 8 connection(s)
I20260923 19:42:10.305721 18900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:10.309736 18966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:10.311828 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 18900
I20260923 19:42:10.312033 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:10.312847 13667 external_mini_cluster.cc:1428] Setting key 37713891a2c57a88aef72200bbec5d8b
I20260923 19:42:10.321919 18966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522: Bootstrap starting.
I20260923 19:42:10.325039 18966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:10.326112 18966 log.cc:824] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:10.326385 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:10.314896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37072 (local address 127.13.88.254:37739)
0923 19:42:10.315962 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:10.315974 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:10.316022 (+ 48us) server_negotiation.cc:407] Connection header received
0923 19:42:10.317679 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:10.317702 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:10.318218 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:10.318607 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:10.319238 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:10.320561 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:10.321910 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:10.322656 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:10.322837 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:10.324060 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:10.324067 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:10.324082 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:10.324613 (+ 531us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:10.324697 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:10.324717 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:10.324839 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:10.325065 (+ 226us) server_negotiation.cc:299] Negotiation successful
0923 19:42:10.325433 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":378,"threads_started":1}
I20260923 19:42:10.329298 18966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522: No bootstrap required, opened a new log
I20260923 19:42:10.330407 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:42:10.337472 18966 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac29b86332db46289d896947e8f47522" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37739 } }
I20260923 19:42:10.337916 18966 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:10.338037 18966 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac29b86332db46289d896947e8f47522, State: Initialized, Role: FOLLOWER
I20260923 19:42:10.338698 18966 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac29b86332db46289d896947e8f47522" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37739 } }
I20260923 19:42:10.338953 18966 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:10.339107 18966 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:10.339308 18966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:10.341830 18966 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac29b86332db46289d896947e8f47522" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37739 } }
I20260923 19:42:10.342314 18966 leader_election.cc:302] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac29b86332db46289d896947e8f47522; no voters:
I20260923 19:42:10.342864 18966 leader_election.cc:288] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:10.343017 18971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:10.343828 18971 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [term 1 LEADER]: Becoming Leader. State: Replica: ac29b86332db46289d896947e8f47522, State: Running, Role: LEADER
I20260923 19:42:10.344403 18971 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac29b86332db46289d896947e8f47522" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37739 } }
I20260923 19:42:10.345219 18966 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:10.347630 18973 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac29b86332db46289d896947e8f47522. Latest consensus state: current_term: 1 leader_uuid: "ac29b86332db46289d896947e8f47522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac29b86332db46289d896947e8f47522" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37739 } } }
I20260923 19:42:10.347837 18972 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac29b86332db46289d896947e8f47522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac29b86332db46289d896947e8f47522" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37739 } } }
I20260923 19:42:10.348114 18973 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:10.348151 18972 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:10.349824 18980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:10.354549 18980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:10.363463 18980 catalog_manager.cc:1347] Generated new cluster ID: 5dc7056df3ac4878ac5ec517b9e1f520
I20260923 19:42:10.363607 18980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:10.394765 18980 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:10.396596 18980 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:10.408645 18980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac29b86332db46289d896947e8f47522: Generated new TSK 0
I20260923 19:42:10.409699 18980 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 19:42:10.463757 18996 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260923 19:42:10.463886 18996 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 19:42:10.464980 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:10.438013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37084 (local address 127.13.88.254:37739)
0923 19:42:10.438220 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:10.438227 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:10.438677 (+ 450us) server_negotiation.cc:407] Connection header received
0923 19:42:10.438986 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:10.438990 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:10.439063 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:10.439278 (+ 215us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:42:10.439738 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:10.440478 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:10.441854 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:10.442311 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:10.442456 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:10.442946 (+ 490us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:42:10.464254 (+ 21308us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34165/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 19:42:10.464640 (+ 386us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37084: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34165/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":64}
W20260923 19:42:10.465117 18969 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37084: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34165/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260923 19:42:10.465221 18995 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:10.437856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:37739 (local address 127.0.0.1:37084)
0923 19:42:10.438561 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:10.438577 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:10.438757 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:10.439294 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:10.439299 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:10.439311 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:42:10.439575 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:10.439584 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:10.440617 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:10.440624 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:10.441710 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:10.441721 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:10.442512 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:10.442519 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:10.442655 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:10.442688 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:42:10.464515 (+ 21827us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34165/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 19:42:10.464804 (+ 289us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.88.254:37739: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34165/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":379,"threads_started":1}
I20260923 19:42:10.466661 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 18900
I20260923 19:42:10.467935 18961 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:10.562412 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 18900
2026-09-23T19:42:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (737 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260923 19:42:10.617216 13667 mini_oidc.cc:152] Starting JWKS server
I20260923 19:42:10.619045 13667 webserver.cc:460] Webserver started at https://127.0.0.1:37861/ using document root <none> and password file <none>
I20260923 19:42:10.619308 13667 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 19:42:10.619904 13667 webserver.cc:460] Webserver started at http://127.0.0.1:36783/ using document root <none> and password file <none>
2026-09-23T19:42:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:10Z Disabled control of system clock
I20260923 19:42:10.644738 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:33481
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:43843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:33481
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37861/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 19:42:10.958300 19003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:10.958563 19003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:10.958662 19003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:10.965729 19003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:10.965832 19003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:10.965869 19003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:10.965919 19003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:10.965969 19003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:42:10.966030 19003 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:42:10.966068 19003 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37861/jwks.json
I20260923 19:42:10.974673 19003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:33481
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:33481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37861/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:10.975927 19003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:10.977654 19003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:10.989018 19009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:10.988989 19008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:10.989053 19011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:10.990005 19003 server_base.cc:1034] running on GCE node
I20260923 19:42:10.990747 19003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:10.992190 19003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:10.993414 19003 hybrid_clock.cc:648] HybridClock initialized: now 1790192530993384 us; error 57 us; skew 500 ppm
I20260923 19:42:10.993759 19003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:10.995991 19003 webserver.cc:460] Webserver started at http://127.13.88.254:42929/ using document root <none> and password file <none>
I20260923 19:42:10.996683 19003 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:10.996814 19003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:10.997140 19003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:11.000070 19003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "7dba0ab165fe4b82ac470d2af767b2a8"
format_stamp: "Formatted at 2026-09-23 19:42:10 on dist-test-slave-xg7f"
server_key: "aae035afcb8f07735eac22293662d8ef"
server_key_iv: "12548073ffacd609a7cb9fe550af8f2c"
server_key_version: "encryptionkey@0"
I20260923 19:42:11.000864 19003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "7dba0ab165fe4b82ac470d2af767b2a8"
format_stamp: "Formatted at 2026-09-23 19:42:10 on dist-test-slave-xg7f"
server_key: "aae035afcb8f07735eac22293662d8ef"
server_key_iv: "12548073ffacd609a7cb9fe550af8f2c"
server_key_version: "encryptionkey@0"
I20260923 19:42:11.005959 19003 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:42:11.009514 19017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:11.010892 19003 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:11.011086 19003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "7dba0ab165fe4b82ac470d2af767b2a8"
format_stamp: "Formatted at 2026-09-23 19:42:10 on dist-test-slave-xg7f"
server_key: "aae035afcb8f07735eac22293662d8ef"
server_key_iv: "12548073ffacd609a7cb9fe550af8f2c"
server_key_version: "encryptionkey@0"
I20260923 19:42:11.011376 19003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:11.045799 19003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:11.046705 19003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:11.047048 19003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:11.065233 19003 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:33481
I20260923 19:42:11.065251 19068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:33481 every 8 connection(s)
I20260923 19:42:11.066612 19003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:11.070367 19069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:11.072829 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19003
I20260923 19:42:11.073041 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:11.073879 13667 external_mini_cluster.cc:1428] Setting key 80ca1f85e1a52d59748608031c48f2c5
I20260923 19:42:11.082846 19069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8: Bootstrap starting.
I20260923 19:42:11.085906 19069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:11.087062 19069 log.cc:824] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:11.088043 19072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:11.075962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59484 (local address 127.13.88.254:33481)
0923 19:42:11.076964 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:11.076975 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:11.077015 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:42:11.078597 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:11.078618 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:11.079227 (+ 609us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:11.079611 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:11.080192 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.082060 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.083457 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.084111 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.084341 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:11.085450 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:11.085458 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:11.085471 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:11.086037 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:11.086150 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:11.086171 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:11.086298 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:11.086516 (+ 218us) server_negotiation.cc:299] Negotiation successful
0923 19:42:11.086810 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":353,"threads_started":1}
I20260923 19:42:11.090226 19069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8: No bootstrap required, opened a new log
I20260923 19:42:11.091778 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:42:11.097750 19069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 33481 } }
I20260923 19:42:11.098104 19069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:11.098204 19069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dba0ab165fe4b82ac470d2af767b2a8, State: Initialized, Role: FOLLOWER
I20260923 19:42:11.098770 19069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 33481 } }
I20260923 19:42:11.098992 19069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:11.099143 19069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:11.099311 19069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:11.101637 19069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 33481 } }
I20260923 19:42:11.102130 19069 leader_election.cc:302] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7dba0ab165fe4b82ac470d2af767b2a8; no voters:
I20260923 19:42:11.102682 19069 leader_election.cc:288] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:11.102823 19074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:11.104255 19074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [term 1 LEADER]: Becoming Leader. State: Replica: 7dba0ab165fe4b82ac470d2af767b2a8, State: Running, Role: LEADER
I20260923 19:42:11.104741 19074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 33481 } }
I20260923 19:42:11.105003 19069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:11.107618 19076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7dba0ab165fe4b82ac470d2af767b2a8. Latest consensus state: current_term: 1 leader_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 33481 } } }
I20260923 19:42:11.108145 19076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:11.107746 19075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7dba0ab165fe4b82ac470d2af767b2a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 33481 } } }
I20260923 19:42:11.108783 19075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:11.110577 19081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:11.116109 19081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:11.116839 19091 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:42:11.124699 19081 catalog_manager.cc:1347] Generated new cluster ID: 27135f0932454595a4e9062a35fc6857
I20260923 19:42:11.124825 19081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:11.143659 19081 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:11.144936 19081 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:11.151211 19081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7dba0ab165fe4b82ac470d2af767b2a8: Generated new TSK 0
I20260923 19:42:11.152072 19081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:42:11.176210 19072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:11.167671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.13.88.254:33481)
0923 19:42:11.167926 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:11.167932 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:11.168322 (+ 390us) server_negotiation.cc:407] Connection header received
0923 19:42:11.168601 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:11.168605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:11.168672 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:11.168801 (+ 129us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:42:11.169364 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.170104 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.172110 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.172553 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.172642 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:11.173242 (+ 600us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:42:11.175581 (+ 2339us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 19:42:11.175902 (+ 321us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":71}
W20260923 19:42:11.176333 19072 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59488: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260923 19:42:11.178319 19098 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:11.167497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:33481 (local address 127.0.0.1:59488)
0923 19:42:11.168216 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:11.168236 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:11.168407 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:11.168851 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:11.168857 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:11.168871 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:42:11.169211 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:11.169223 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.170247 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.170252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:11.171975 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:11.171992 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.172737 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.172744 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:11.172959 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:11.173005 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:42:11.175819 (+ 2814us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 19:42:11.177872 (+ 2053us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.88.254:33481: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37861/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":1747,"thread_start_us":387,"threads_started":1}
I20260923 19:42:11.180042 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19003
I20260923 19:42:11.181288 19064 generic_service.cc:196] Checking for leaks (request via RPC)
E20260923 19:42:11.188112 19099 webserver.cc:533] Webserver: sslize failed:
E20260923 19:42:11.188198 19099 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 19:42:11.270493 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19003
2026-09-23T19:42:11Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (708 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-23T19:42:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:11Z Disabled control of system clock
I20260923 19:42:11.351351 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38801
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:44803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:38801
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/testchainca.cert with env {}
W20260923 19:42:11.673997 19104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:11.674289 19104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:11.674465 19104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:11.681648 19104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:11.681752 19104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:11.681788 19104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:11.681872 19104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:11.681950 19104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:42:11.682090 19104 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 19:42:11.682147 19104 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260923 19:42:11.692178 19104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:44803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:38801
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:11.693526 19104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:11.694873 19104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:11.706300 19112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:11.706375 19110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:11.706410 19109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:11.707417 19104 server_base.cc:1034] running on GCE node
I20260923 19:42:11.708098 19104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:11.709415 19104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:11.710600 19104 hybrid_clock.cc:648] HybridClock initialized: now 1790192531710555 us; error 35 us; skew 500 ppm
I20260923 19:42:11.710927 19104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:11.713074 19104 webserver.cc:460] Webserver started at http://127.13.88.254:39121/ using document root <none> and password file <none>
I20260923 19:42:11.713727 19104 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:11.713840 19104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:11.714152 19104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:11.716959 19104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "3cfe97e7db684b72b1e256bd214aaf36"
format_stamp: "Formatted at 2026-09-23 19:42:11 on dist-test-slave-xg7f"
server_key: "6cfeb46d6b8c60310a6ffd9e4d755886"
server_key_iv: "2cee3fbdbca6107c35ac6cc621b3e890"
server_key_version: "encryptionkey@0"
I20260923 19:42:11.717742 19104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "3cfe97e7db684b72b1e256bd214aaf36"
format_stamp: "Formatted at 2026-09-23 19:42:11 on dist-test-slave-xg7f"
server_key: "6cfeb46d6b8c60310a6ffd9e4d755886"
server_key_iv: "2cee3fbdbca6107c35ac6cc621b3e890"
server_key_version: "encryptionkey@0"
I20260923 19:42:11.722436 19104 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260923 19:42:11.725744 19118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:11.727077 19104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:11.727319 19104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "3cfe97e7db684b72b1e256bd214aaf36"
format_stamp: "Formatted at 2026-09-23 19:42:11 on dist-test-slave-xg7f"
server_key: "6cfeb46d6b8c60310a6ffd9e4d755886"
server_key_iv: "2cee3fbdbca6107c35ac6cc621b3e890"
server_key_version: "encryptionkey@0"
I20260923 19:42:11.727546 19104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:11.746523 19104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:11.747433 19104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:11.747714 19104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:11.765749 19104 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:38801
I20260923 19:42:11.765761 19169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:38801 every 8 connection(s)
I20260923 19:42:11.767068 19104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:11.770478 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19104
I20260923 19:42:11.770684 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:11.770834 19170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:11.771404 13667 external_mini_cluster.cc:1428] Setting key 46d49e4741a64a1b2045d7b4675f72ac
I20260923 19:42:11.783891 19170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36: Bootstrap starting.
I20260923 19:42:11.785274 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:11.773218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34560 (local address 127.13.88.254:38801)
0923 19:42:11.774268 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:11.774278 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:11.774321 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:42:11.776525 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:11.776547 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:11.777046 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:11.777400 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:11.777965 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.779283 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.781064 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.781718 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.781843 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:11.782994 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:11.783001 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:11.783014 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:11.783594 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:11.783666 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:11.783686 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:11.783766 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:11.784030 (+ 264us) server_negotiation.cc:299] Negotiation successful
0923 19:42:11.784352 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":432,"threads_started":1}
I20260923 19:42:11.787005 19170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:11.788169 19170 log.cc:824] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:11.788923 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:42:11.790719 19170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36: No bootstrap required, opened a new log
I20260923 19:42:11.798373 19170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cfe97e7db684b72b1e256bd214aaf36" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38801 } }
I20260923 19:42:11.798784 19170 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:11.798893 19170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe97e7db684b72b1e256bd214aaf36, State: Initialized, Role: FOLLOWER
I20260923 19:42:11.799520 19170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cfe97e7db684b72b1e256bd214aaf36" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38801 } }
I20260923 19:42:11.799744 19170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:11.799887 19170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:11.800071 19170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:11.802268 19170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cfe97e7db684b72b1e256bd214aaf36" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38801 } }
I20260923 19:42:11.802779 19170 leader_election.cc:302] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cfe97e7db684b72b1e256bd214aaf36; no voters:
I20260923 19:42:11.803447 19170 leader_election.cc:288] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:11.803644 19175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:11.804291 19175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe97e7db684b72b1e256bd214aaf36, State: Running, Role: LEADER
I20260923 19:42:11.804826 19175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cfe97e7db684b72b1e256bd214aaf36" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38801 } }
I20260923 19:42:11.805570 19170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:11.807624 19177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cfe97e7db684b72b1e256bd214aaf36. Latest consensus state: current_term: 1 leader_uuid: "3cfe97e7db684b72b1e256bd214aaf36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cfe97e7db684b72b1e256bd214aaf36" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38801 } } }
I20260923 19:42:11.807981 19177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:11.808980 19182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:11.809329 19176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cfe97e7db684b72b1e256bd214aaf36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cfe97e7db684b72b1e256bd214aaf36" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38801 } } }
I20260923 19:42:11.809717 19176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:11.815645 19182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:11.824118 19182 catalog_manager.cc:1347] Generated new cluster ID: d8c846ff9c4c436ca3c41f865f60e738
I20260923 19:42:11.824229 19182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:11.851478 19182 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:11.852823 19182 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:11.863281 19182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cfe97e7db684b72b1e256bd214aaf36: Generated new TSK 0
I20260923 19:42:11.864111 19182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:42:12.359771 19173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:11.884965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34562 (local address 127.13.88.254:38801)
0923 19:42:11.885223 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:11.885230 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:11.885606 (+ 376us) server_negotiation.cc:407] Connection header received
0923 19:42:11.885832 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:11.885835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:11.885909 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:11.886045 (+ 136us) server_negotiation.cc:226] Negotiated authn=JWT
0923 19:42:11.886563 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.887367 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.889375 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.889797 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.889884 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:11.890430 (+ 546us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 19:42:12.359196 (+468766us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 19:42:12.359550 (+ 354us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34562: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":68}
W20260923 19:42:12.359869 19173 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34562: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260923 19:42:12.360272 19199 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:11.884899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38801 (local address 127.0.0.1:34562)
0923 19:42:11.885495 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:11.885516 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:11.885677 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:11.886099 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:11.886105 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:11.886119 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0923 19:42:11.886420 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:11.886431 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.887506 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.887512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:11.889241 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:11.889256 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:11.889961 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:11.889968 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:11.890157 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:11.890201 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 19:42:12.359581 (+469380us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 19:42:12.359820 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.13.88.254:38801: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":301,"threads_started":1}
I20260923 19:42:12.361599 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19104
I20260923 19:42:12.362749 19165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:12.463023 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19104
2026-09-23T19:42:12Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1173 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (402 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (410 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:42:13 dist-test-slave-xg7f krb5kdc[19214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:42:13 dist-test-slave-xg7f krb5kdc[19214](info): set up 2 sockets
Sep 23 19:42:13 dist-test-slave-xg7f krb5kdc[19214](info): commencing operation
krb5kdc: starting...
W20260923 19:42:14.371749 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:42:14 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:42:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:42:14.568068 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36889
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:36889
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:14.880316 19227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:14.880606 19227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:14.880781 19227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:14.887925 19227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:14.888021 19227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:14.888136 19227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:14.888236 19227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:14.888316 19227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:14.897992 19227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:36889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:14.899328 19227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:14.900615 19227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:14.912473 19233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:14.912457 19232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:14.912602 19235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:14.913105 19227 server_base.cc:1034] running on GCE node
I20260923 19:42:14.913944 19227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:14.915386 19227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:14.916620 19227 hybrid_clock.cc:648] HybridClock initialized: now 1790192534916567 us; error 58 us; skew 500 ppm
I20260923 19:42:14.916966 19227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:14 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192534, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:14.920064 19227 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:42:14.921464 19227 webserver.cc:460] Webserver started at http://127.13.88.254:32969/ using document root <none> and password file <none>
I20260923 19:42:14.922144 19227 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:14.922283 19227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:14.922598 19227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:14.925678 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "61234c871ff645568c659c53fad51ede"
format_stamp: "Formatted at 2026-09-23 19:42:14 on dist-test-slave-xg7f"
server_key: "b57715bca7f6661d7287cf4df18bad3c"
server_key_iv: "e6ac6d51b3854937704709d1793d7923"
server_key_version: "encryptionkey@0"
I20260923 19:42:14.926465 19227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "61234c871ff645568c659c53fad51ede"
format_stamp: "Formatted at 2026-09-23 19:42:14 on dist-test-slave-xg7f"
server_key: "b57715bca7f6661d7287cf4df18bad3c"
server_key_iv: "e6ac6d51b3854937704709d1793d7923"
server_key_version: "encryptionkey@0"
I20260923 19:42:14.931538 19227 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:42:14.934785 19242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:14.936074 19227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:14.936254 19227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "61234c871ff645568c659c53fad51ede"
format_stamp: "Formatted at 2026-09-23 19:42:14 on dist-test-slave-xg7f"
server_key: "b57715bca7f6661d7287cf4df18bad3c"
server_key_iv: "e6ac6d51b3854937704709d1793d7923"
server_key_version: "encryptionkey@0"
I20260923 19:42:14.936455 19227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:14.952203 19227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:14.956481 19227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:14.956771 19227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:14.974896 19227 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:36889
I20260923 19:42:14.974926 19293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:36889 every 8 connection(s)
I20260923 19:42:14.976361 19227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:14.976938 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19227
I20260923 19:42:14.977167 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:14.977975 13667 external_mini_cluster.cc:1428] Setting key 9f5d3f968ddc4c3758ade567dba18716
I20260923 19:42:14.980960 19294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:42:14 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:14.993716 19294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede: Bootstrap starting.
I20260923 19:42:14.997042 19294 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:14.998232 19294 log.cc:824] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:15.001519 19294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede: No bootstrap required, opened a new log
I20260923 19:42:15.001994 19297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:14.980068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43406 (local address 127.13.88.254:36889)
0923 19:42:14.980864 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:14.980882 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:14.980936 (+ 54us) server_negotiation.cc:407] Connection header received
0923 19:42:14.983288 (+ 2352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:14.983316 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:14.983843 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:14.984296 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:14.985553 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:14.987675 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:14.988871 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:14.989866 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:14.990054 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:14.994337 (+ 4283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:14.994346 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:14.994360 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:14.994396 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:14.997630 (+ 3234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:14.998478 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:14.998491 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:14.998498 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:14.998666 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:14.999187 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:14.999194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:14.999201 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:14.999867 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:15.000067 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:15.000540 (+ 473us) server_negotiation.cc:299] Negotiation successful
0923 19:42:15.000905 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":342,"threads_started":1}
I20260923 19:42:15.009470 19294 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61234c871ff645568c659c53fad51ede" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36889 } }
I20260923 19:42:15.009857 19294 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:15.009963 19294 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61234c871ff645568c659c53fad51ede, State: Initialized, Role: FOLLOWER
I20260923 19:42:15.010497 19294 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61234c871ff645568c659c53fad51ede" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36889 } }
I20260923 19:42:15.010748 19294 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:15.010901 19294 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:15.011171 19294 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:15.013300 19294 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61234c871ff645568c659c53fad51ede" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36889 } }
I20260923 19:42:15.013813 19294 leader_election.cc:302] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61234c871ff645568c659c53fad51ede; no voters:
I20260923 19:42:15.014564 19294 leader_election.cc:288] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:15.014731 19299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:15.015435 19299 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [term 1 LEADER]: Becoming Leader. State: Replica: 61234c871ff645568c659c53fad51ede, State: Running, Role: LEADER
I20260923 19:42:15.016026 19299 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61234c871ff645568c659c53fad51ede" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36889 } }
I20260923 19:42:15.016682 19294 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:15.018852 19301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61234c871ff645568c659c53fad51ede. Latest consensus state: current_term: 1 leader_uuid: "61234c871ff645568c659c53fad51ede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61234c871ff645568c659c53fad51ede" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36889 } } }
I20260923 19:42:15.019331 19301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:15.019469 19300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61234c871ff645568c659c53fad51ede" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61234c871ff645568c659c53fad51ede" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36889 } } }
I20260923 19:42:15.019752 19300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:15.022351 19305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:15.027729 19305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:15.035858 19305 catalog_manager.cc:1347] Generated new cluster ID: d67808da604a4ebd8920c2f77346160f
I20260923 19:42:15.035983 19305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:15.064634 19305 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:15.065980 19305 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:15.073542 19305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61234c871ff645568c659c53fad51ede: Generated new TSK 0
I20260923 19:42:15.074563 19305 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:42:15.136701 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36889
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:15.475243 19320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:15.475528 19320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:15.475622 19320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:15.482580 19320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:15.482684 19320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:15.482859 19320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:15.492534 19320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:15.493716 19320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:15.494932 19320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:15.507442 19325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:15.507472 19326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:15.508018 19328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:15.508651 19320 server_base.cc:1034] running on GCE node
I20260923 19:42:15.509232 19320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:15.510119 19320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:15.511333 19320 hybrid_clock.cc:648] HybridClock initialized: now 1790192535511291 us; error 61 us; skew 500 ppm
I20260923 19:42:15.511633 19320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:15 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192535, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:15.514699 19320 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:42:15.516158 19320 webserver.cc:460] Webserver started at http://127.13.88.193:38663/ using document root <none> and password file <none>
I20260923 19:42:15.516875 19320 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:15.517030 19320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:15.517478 19320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:15.520589 19320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "8c91596362aa413f8eeeb5f3d63bcb5b"
format_stamp: "Formatted at 2026-09-23 19:42:15 on dist-test-slave-xg7f"
server_key: "f6b193a0371bab16e1e8f5adabe5c22d"
server_key_iv: "efe9a814c5e0c4cddf4af7a704d62518"
server_key_version: "encryptionkey@0"
I20260923 19:42:15.521693 19320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "8c91596362aa413f8eeeb5f3d63bcb5b"
format_stamp: "Formatted at 2026-09-23 19:42:15 on dist-test-slave-xg7f"
server_key: "f6b193a0371bab16e1e8f5adabe5c22d"
server_key_iv: "efe9a814c5e0c4cddf4af7a704d62518"
server_key_version: "encryptionkey@0"
I20260923 19:42:15.528520 19320 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.007s
I20260923 19:42:15.531932 19335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:15.533247 19320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:42:15.533420 19320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "8c91596362aa413f8eeeb5f3d63bcb5b"
format_stamp: "Formatted at 2026-09-23 19:42:15 on dist-test-slave-xg7f"
server_key: "f6b193a0371bab16e1e8f5adabe5c22d"
server_key_iv: "efe9a814c5e0c4cddf4af7a704d62518"
server_key_version: "encryptionkey@0"
I20260923 19:42:15.533620 19320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:15.555989 19320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:15.560051 19320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:15.560343 19320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:15.561324 19320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:15.562649 19320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:15.562755 19320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:15.562904 19320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:15.562978 19320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:15.595041 19320 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:32847
I20260923 19:42:15.595084 19447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:32847 every 8 connection(s)
I20260923 19:42:15.596365 19320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:15.599740 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19320
I20260923 19:42:15.599975 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:15.600760 13667 external_mini_cluster.cc:1428] Setting key dc9bb98a1d31813ccbc2df8781cfe807
Sep 23 19:42:15 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192535, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:15.616389 19450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:15.598867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:49309 (local address 127.13.88.254:36889)
0923 19:42:15.599327 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:15.599332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:15.600462 (+ 1130us) server_negotiation.cc:407] Connection header received
0923 19:42:15.602235 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:15.602241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:15.602339 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:15.602455 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:15.603969 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:15.604666 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:15.606185 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:15.606579 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:15.606709 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:15.610697 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:15.610703 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:15.610706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:15.610737 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:15.613311 (+ 2574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:15.614015 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:15.614027 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:15.614029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:15.614139 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:15.614554 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:15.614558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:15.614563 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:15.614841 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:15.615017 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:15.615768 (+ 751us) server_negotiation.cc:299] Negotiation successful
0923 19:42:15.615997 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":259,"threads_started":1}
I20260923 19:42:15.617309 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:15.599443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36889 (local address 127.13.88.193:49309)
0923 19:42:15.600307 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:15.600350 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:15.601968 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:15.602684 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:15.602692 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:15.603240 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:15.603794 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:15.603810 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:15.604811 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:15.604821 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:15.606044 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:15.606056 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:15.606808 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:15.606818 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:15.607052 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:15.607850 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:15.607883 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:15.610478 (+ 2595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:15.613457 (+ 2979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:15.613466 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:15.613482 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:15.613893 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:15.614244 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:15.614249 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:15.614253 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:15.614439 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:15.614985 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:15.614993 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:15.615405 (+ 412us) client_negotiation.cc:769] Sending connection context
0923 19:42:15.615664 (+ 259us) client_negotiation.cc:240] Negotiation successful
0923 19:42:15.616193 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":373,"threads_started":1}
I20260923 19:42:15.618809 19448 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36889
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:42:15.619154 19448 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:15.619849 19448 heartbeater.cc:511] Master 127.13.88.254:36889 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
I20260923 19:42:15.622155 19259 ts_manager.cc:194] Registered new tserver with Master: 8c91596362aa413f8eeeb5f3d63bcb5b (127.13.88.193:32847)
I20260923 19:42:15.623647 19259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:49309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:42:15.643642 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36889
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:15.966502 19454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:15.966773 19454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:15.966861 19454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:15.974063 19454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:15.974181 19454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:15.974367 19454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:15.989455 19454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:15.991039 19454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:15.992784 19454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:16.006517 19460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:16.006577 19462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:16.006603 19459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:16.007550 19454 server_base.cc:1034] running on GCE node
I20260923 19:42:16.008140 19454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:16.009050 19454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:16.010272 19454 hybrid_clock.cc:648] HybridClock initialized: now 1790192536010223 us; error 44 us; skew 500 ppm
I20260923 19:42:16.010584 19454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.013643 19454 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:42:16.015025 19454 webserver.cc:460] Webserver started at http://127.13.88.194:41439/ using document root <none> and password file <none>
I20260923 19:42:16.015723 19454 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:16.015863 19454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:16.016165 19454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:16.019043 19454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "5fd9559bc21c42fa8b61a703bbab28bb"
format_stamp: "Formatted at 2026-09-23 19:42:16 on dist-test-slave-xg7f"
server_key: "9302de7a960e28d186bc2ca01b84bbe9"
server_key_iv: "61d19edfe92806c5f47b0373c07e025b"
server_key_version: "encryptionkey@0"
I20260923 19:42:16.019891 19454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "5fd9559bc21c42fa8b61a703bbab28bb"
format_stamp: "Formatted at 2026-09-23 19:42:16 on dist-test-slave-xg7f"
server_key: "9302de7a960e28d186bc2ca01b84bbe9"
server_key_iv: "61d19edfe92806c5f47b0373c07e025b"
server_key_version: "encryptionkey@0"
I20260923 19:42:16.024945 19454 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:42:16.028312 19469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:16.029639 19454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:16.029807 19454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "5fd9559bc21c42fa8b61a703bbab28bb"
format_stamp: "Formatted at 2026-09-23 19:42:16 on dist-test-slave-xg7f"
server_key: "9302de7a960e28d186bc2ca01b84bbe9"
server_key_iv: "61d19edfe92806c5f47b0373c07e025b"
server_key_version: "encryptionkey@0"
I20260923 19:42:16.030010 19454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:16.059295 19454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:16.064204 19454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:16.064500 19454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:16.065457 19454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:16.066752 19454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:16.066852 19454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:16.066993 19454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:16.067071 19454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:16.099567 19454 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:41029
I20260923 19:42:16.099612 19581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:41029 every 8 connection(s)
I20260923 19:42:16.100847 19454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:16.102361 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19454
I20260923 19:42:16.102504 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:16.102866 13667 external_mini_cluster.cc:1428] Setting key b928f450bc2402fbac96068a31ae91c3
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:42:16.121835 19450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.104429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:54883 (local address 127.13.88.254:36889)
0923 19:42:16.104622 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.104628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.105916 (+ 1288us) server_negotiation.cc:407] Connection header received
0923 19:42:16.107795 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.107800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.107882 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.107989 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.109539 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.110244 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.111848 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.112335 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.112468 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.116105 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.116110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.116114 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.116144 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.118826 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.119591 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.119602 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.119604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.119723 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.120150 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.120155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.120158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.120403 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.120544 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.121275 (+ 731us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.121501 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:16.122936 19584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.105036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36889 (local address 127.13.88.194:54883)
0923 19:42:16.105767 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:16.105806 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:16.107541 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:16.108203 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:16.108211 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:16.108808 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:16.109381 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:16.109405 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.110399 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.110403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:16.111693 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:16.111705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.112561 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.112568 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:16.112793 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.113513 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:16.113535 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:16.115856 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:16.118964 (+ 3108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:16.118972 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:16.118990 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:16.119468 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:16.119826 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:16.119832 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:16.119835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:16.120037 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:16.120519 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:16.120527 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:16.120858 (+ 331us) client_negotiation.cc:769] Sending connection context
0923 19:42:16.121171 (+ 313us) client_negotiation.cc:240] Negotiation successful
0923 19:42:16.121676 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":328,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
I20260923 19:42:16.124441 19582 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36889
I20260923 19:42:16.124740 19582 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:16.125409 19582 heartbeater.cc:511] Master 127.13.88.254:36889 requested a full tablet report, sending...
I20260923 19:42:16.126910 19259 ts_manager.cc:194] Registered new tserver with Master: 5fd9559bc21c42fa8b61a703bbab28bb (127.13.88.194:41029)
I20260923 19:42:16.128163 19259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:54883
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:42:16.147392 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36889
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:16.465826 19587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:16.466087 19587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:16.466230 19587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:16.473292 19587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:16.473417 19587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:16.473603 19587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:16.483238 19587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36889
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:16.484594 19587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:16.485912 19587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:16.498858 19595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:16.498926 19593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:16.498950 19592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:16.499691 19587 server_base.cc:1034] running on GCE node
I20260923 19:42:16.500285 19587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:16.501176 19587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:16.502389 19587 hybrid_clock.cc:648] HybridClock initialized: now 1790192536502333 us; error 56 us; skew 500 ppm
I20260923 19:42:16.502698 19587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.505803 19587 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:42:16.507211 19587 webserver.cc:460] Webserver started at http://127.13.88.195:42693/ using document root <none> and password file <none>
I20260923 19:42:16.507892 19587 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:16.508044 19587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:16.508344 19587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:16.511216 19587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "99376c4d49b942ad845603c5a6c35178"
format_stamp: "Formatted at 2026-09-23 19:42:16 on dist-test-slave-xg7f"
server_key: "6bcc3d9477b124bd7e63124801abc823"
server_key_iv: "b345657de7745845a68750f5ca07a844"
server_key_version: "encryptionkey@0"
I20260923 19:42:16.512086 19587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "99376c4d49b942ad845603c5a6c35178"
format_stamp: "Formatted at 2026-09-23 19:42:16 on dist-test-slave-xg7f"
server_key: "6bcc3d9477b124bd7e63124801abc823"
server_key_iv: "b345657de7745845a68750f5ca07a844"
server_key_version: "encryptionkey@0"
I20260923 19:42:16.517243 19587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:42:16.520880 19602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:16.522431 19587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:42:16.522603 19587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "99376c4d49b942ad845603c5a6c35178"
format_stamp: "Formatted at 2026-09-23 19:42:16 on dist-test-slave-xg7f"
server_key: "6bcc3d9477b124bd7e63124801abc823"
server_key_iv: "b345657de7745845a68750f5ca07a844"
server_key_version: "encryptionkey@0"
I20260923 19:42:16.522831 19587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:16.534078 19587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:16.538503 19587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:16.538787 19587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:16.539813 19587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:16.541142 19587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:16.541209 19587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:16.541345 19587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:16.541404 19587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:16.572767 19587 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:45337
I20260923 19:42:16.572816 19714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:45337 every 8 connection(s)
I20260923 19:42:16.574059 19587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:16.575872 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19587
I20260923 19:42:16.576042 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:16.576525 13667 external_mini_cluster.cc:1428] Setting key 41e617be5d9b0e97544938622b81e209
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:16.594504 19450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.576666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:47825 (local address 127.13.88.254:36889)
0923 19:42:16.576878 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.576885 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.578574 (+ 1689us) server_negotiation.cc:407] Connection header received
0923 19:42:16.580667 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.580672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.580779 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.580891 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.582341 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.583085 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.584656 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.585074 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.585207 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.588601 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.588607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.588612 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.588654 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.591421 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.592140 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.592147 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.592150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.592279 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.592689 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.592696 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.592699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.592968 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.593156 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.593911 (+ 755us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.594124 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260923 19:42:16.595606 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.577457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36889 (local address 127.13.88.195:47825)
0923 19:42:16.578429 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:16.578484 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:16.580426 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:16.581122 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:16.581131 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:16.581633 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:16.582185 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:16.582202 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.583271 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.583275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:16.584511 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:16.584522 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.585292 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.585300 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:16.585544 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.586241 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:16.586263 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:16.588401 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:16.591556 (+ 3155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:16.591564 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:16.591582 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:16.592021 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:16.592390 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:16.592395 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:16.592399 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:16.592580 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:16.593118 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:16.593125 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:16.593483 (+ 358us) client_negotiation.cc:769] Sending connection context
0923 19:42:16.593821 (+ 338us) client_negotiation.cc:240] Negotiation successful
0923 19:42:16.594389 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":461,"threads_started":1}
I20260923 19:42:16.597088 19715 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36889
I20260923 19:42:16.597388 19715 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:16.598085 19715 heartbeater.cc:511] Master 127.13.88.254:36889 requested a full tablet report, sending...
I20260923 19:42:16.599574 19259 ts_manager.cc:194] Registered new tserver with Master: 99376c4d49b942ad845603c5a6c35178 (127.13.88.195:45337)
I20260923 19:42:16.600602 19259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:47825
I20260923 19:42:16.604416 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:42:16.626480 19448 heartbeater.cc:503] Master 127.13.88.254:36889 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/test-admin.keytab.
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.630023 13667 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260923 19:42:16.634984 19722 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:16.632562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48262 (local address 127.13.88.193:32847)
0923 19:42:16.633234 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.633242 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.633268 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:42:16.633345 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.633352 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.633616 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.633753 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.634600 (+ 847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48262: BlockingRecv error: recv got EOF from 127.0.0.1:48262 (error 108)
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":328,"threads_started":1}
W20260923 19:42:16.635131 13667 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5cc' of type FILE
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.636811 13667 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.638322 13667 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:42:16.653272 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.640070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48270 (local address 127.13.88.193:32847)
0923 19:42:16.640223 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.640227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.640573 (+ 346us) server_negotiation.cc:407] Connection header received
0923 19:42:16.640760 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.640763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.640822 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.640912 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.641861 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.642818 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.644060 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.644626 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.644722 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.648143 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.648153 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.648167 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.648202 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.650709 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.651465 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.651472 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.651474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.651590 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.651952 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.651955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.651957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.652286 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.652500 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.652800 (+ 300us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.653004 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 19:42:16.658706 19722 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:16.657125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48286 (local address 127.13.88.193:32847)
0923 19:42:16.657368 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.657373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.657567 (+ 194us) server_negotiation.cc:407] Connection header received
0923 19:42:16.657687 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.657691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.657754 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.657831 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.658457 (+ 626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48286: BlockingRecv error: recv got EOF from 127.0.0.1:48286 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260923 19:42:16.658789 13667 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5cc' of type FILE
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.660378 13667 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.661607 13667 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:42:16.675272 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.662864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48300 (local address 127.13.88.193:32847)
0923 19:42:16.663135 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.663141 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.663526 (+ 385us) server_negotiation.cc:407] Connection header received
0923 19:42:16.663643 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.663646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.663703 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.663799 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.664688 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.665381 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.666618 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.667059 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.667245 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.670476 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.670481 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.670484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.670526 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.673145 (+ 2619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.673736 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.673740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.673742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.673869 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.674157 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.674160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.674162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.674399 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.674589 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.674823 (+ 234us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.674972 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260923 19:42:16.679649 19722 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:16.677735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48304 (local address 127.13.88.193:32847)
0923 19:42:16.677927 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.677934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.678276 (+ 342us) server_negotiation.cc:407] Connection header received
0923 19:42:16.678460 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.678465 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.678545 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.678643 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.679411 (+ 768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48304: BlockingRecv error: recv got EOF from 127.0.0.1:48304 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260923 19:42:16.679963 13667 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790192489293654-13667-0/krb5kdc/krb5cc' of type FILE
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.681392 13667 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:16.682597 13667 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:42:16.695715 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.683858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48310 (local address 127.13.88.193:32847)
0923 19:42:16.684056 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.684062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.684285 (+ 223us) server_negotiation.cc:407] Connection header received
0923 19:42:16.684387 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.684391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.684443 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.684517 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.685396 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.686083 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.687299 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.687734 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.687828 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.691000 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.691005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.691008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.691037 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.693481 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.694114 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.694119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.694121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.694250 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.694531 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.694533 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.694535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.694760 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.694973 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.695190 (+ 217us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.695383 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:42:16.697122 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19320
I20260923 19:42:16.707898 19722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.697809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48318 (local address 127.13.88.193:32847)
0923 19:42:16.697942 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.697946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.698345 (+ 399us) server_negotiation.cc:407] Connection header received
0923 19:42:16.698465 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.698468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.698518 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.698590 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.699491 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.700128 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.701272 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.701660 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.701739 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.703598 (+ 1859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.703603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.703606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.703632 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.705782 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.706355 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.706358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.706360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.706472 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.706772 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.706775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.706776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.707015 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.707278 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.707512 (+ 234us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.707650 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 19:42:16.708467 19443 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:16.790014 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19320
I20260923 19:42:16.806046 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19454
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:42:16.821559 19735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.806971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.13.88.194:41029)
0923 19:42:16.807534 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.807541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.807564 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:42:16.807622 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.807628 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.807828 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.808002 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.808918 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.809918 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.811230 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.811779 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.811940 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.815713 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.815725 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.815740 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.815773 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.818560 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.819324 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.819331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.819333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.819461 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.819847 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.819852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.819854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.820186 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.820507 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.820859 (+ 352us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.821113 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":295,"threads_started":1}
I20260923 19:42:16.822865 19577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:16.905624 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19454
I20260923 19:42:16.921543 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19587
Sep 23 19:42:16 dist-test-slave-xg7f krb5kdc[19214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:42:16.936928 19737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:16.922624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41092 (local address 127.13.88.195:45337)
0923 19:42:16.923321 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:16.923328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:16.923357 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:42:16.923424 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:16.923430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:16.923646 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:16.923812 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:16.924822 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.925795 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.927097 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:16.927729 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:16.927875 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:16.931720 (+ 3845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:16.931730 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:16.931756 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:16.931786 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:16.934225 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.934860 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.934868 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.934871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.934984 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:16.935440 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:16.935447 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:16.935450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:16.935772 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:16.936087 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:16.936399 (+ 312us) server_negotiation.cc:299] Negotiation successful
0923 19:42:16.936641 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":344,"threads_started":1}
I20260923 19:42:16.938265 19710 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:17.027381 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19587
I20260923 19:42:17.043265 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19227
I20260923 19:42:17.044467 19289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:17.146771 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19227
2026-09-23T19:42:17Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3874 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:42:17 dist-test-slave-xg7f krb5kdc[19742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:42:17 dist-test-slave-xg7f krb5kdc[19742](info): set up 2 sockets
Sep 23 19:42:17 dist-test-slave-xg7f krb5kdc[19742](info): commencing operation
krb5kdc: starting...
W20260923 19:42:18.219815 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.005s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:42:18 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:42:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:18Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab.
Entry for principal oryx/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab.
I20260923 19:42:18.412604 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45369
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab
--principal=oryx/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45369
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:18.722853 19755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:18.723170 19755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:18.723256 19755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:18.730357 19755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:18.730456 19755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:18.730502 19755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:18.730575 19755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:18.730636 19755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:18.740471 19755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab
--principal=oryx/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:18.741778 19755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:18.743064 19755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:18.754668 19763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:18.754871 19760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:18.754881 19761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:18.755766 19755 server_base.cc:1034] running on GCE node
I20260923 19:42:18.756544 19755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:18.757831 19755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:18.759037 19755 hybrid_clock.cc:648] HybridClock initialized: now 1790192538758998 us; error 28 us; skew 500 ppm
I20260923 19:42:18.759411 19755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:18 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:18.767568 19755 init.cc:377] Logged in from keytab as oryx/127.13.88.254@KRBTEST.COM (short username oryx)
I20260923 19:42:18.769083 19755 webserver.cc:460] Webserver started at http://127.13.88.254:45995/ using document root <none> and password file <none>
I20260923 19:42:18.769817 19755 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:18.769965 19755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:18.770345 19755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:18.773520 19755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "134e976966a340ffa2707fe7a13ec7a0"
format_stamp: "Formatted at 2026-09-23 19:42:18 on dist-test-slave-xg7f"
server_key: "794541e38db7416802cb5095947576b4"
server_key_iv: "f6dca187f92ecaa97c5e2b70af47c149"
server_key_version: "encryptionkey@0"
I20260923 19:42:18.774217 19755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "134e976966a340ffa2707fe7a13ec7a0"
format_stamp: "Formatted at 2026-09-23 19:42:18 on dist-test-slave-xg7f"
server_key: "794541e38db7416802cb5095947576b4"
server_key_iv: "f6dca187f92ecaa97c5e2b70af47c149"
server_key_version: "encryptionkey@0"
I20260923 19:42:18.779399 19755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:42:18.782661 19770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:18.783993 19755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:18.784121 19755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "134e976966a340ffa2707fe7a13ec7a0"
format_stamp: "Formatted at 2026-09-23 19:42:18 on dist-test-slave-xg7f"
server_key: "794541e38db7416802cb5095947576b4"
server_key_iv: "f6dca187f92ecaa97c5e2b70af47c149"
server_key_version: "encryptionkey@0"
I20260923 19:42:18.784289 19755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:18.800953 19755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:18.804858 19755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:18.805107 19755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:18.823508 19755 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:45369
I20260923 19:42:18.823529 19821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:45369 every 8 connection(s)
I20260923 19:42:18.824887 19755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:18.828477 19822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:18.830533 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19755
I20260923 19:42:18.830732 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:18.831410 13667 external_mini_cluster.cc:1428] Setting key 536f6bc9a79d6b4228e17abfbe5f5c9e
I20260923 19:42:18.841068 19822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: Bootstrap starting.
I20260923 19:42:18.844523 19822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:18.845467 19822 log.cc:824] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:42:18 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:18.848783 19822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: No bootstrap required, opened a new log
I20260923 19:42:18.855532 19825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:18.833424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35586 (local address 127.13.88.254:45369)
0923 19:42:18.834204 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:18.834230 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:18.834279 (+ 49us) server_negotiation.cc:407] Connection header received
0923 19:42:18.836529 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:18.836556 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:18.837029 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:18.837460 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:18.838737 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:18.840648 (+ 1911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:18.841957 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:18.842932 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:18.843171 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:18.847329 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:18.847339 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:18.847358 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:18.847410 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:18.851250 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:18.851905 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:18.851914 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:18.851926 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:18.852138 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:18.852480 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:18.852485 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:18.852488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:18.853183 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:18.853511 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:18.853754 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 19:42:18.854172 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":303,"threads_started":1}
I20260923 19:42:18.858999 19822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } }
I20260923 19:42:18.859373 19822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:18.859449 19822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 134e976966a340ffa2707fe7a13ec7a0, State: Initialized, Role: FOLLOWER
I20260923 19:42:18.859899 19822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } }
I20260923 19:42:18.860074 19822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:18.860164 19822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:18.860271 19822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:18.862571 19822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } }
I20260923 19:42:18.862980 19822 leader_election.cc:302] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 134e976966a340ffa2707fe7a13ec7a0; no voters:
I20260923 19:42:18.863526 19822 leader_election.cc:288] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:18.863662 19827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:18.864916 19827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 1 LEADER]: Becoming Leader. State: Replica: 134e976966a340ffa2707fe7a13ec7a0, State: Running, Role: LEADER
I20260923 19:42:18.865401 19827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } }
I20260923 19:42:18.865612 19822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:18.868634 19828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } }
I20260923 19:42:18.868609 19829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 134e976966a340ffa2707fe7a13ec7a0. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } }
I20260923 19:42:18.869071 19828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:18.869122 19829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:18.871198 19833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:18.877254 19833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:18.887635 19833 catalog_manager.cc:1347] Generated new cluster ID: 75b8dfb7ff384dec9a9e6003b2797e82
I20260923 19:42:18.887766 19833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:18.915673 19833 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:18.916996 19833 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:18.933353 19833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: Generated new TSK 0
I20260923 19:42:18.934218 19833 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab.
Entry for principal oryx/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab.
I20260923 19:42:18.986992 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45369
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab
--principal=oryx/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:19.340808 19848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:19.341054 19848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:19.341180 19848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:19.348054 19848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:19.348146 19848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:19.348338 19848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:19.357852 19848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab
--principal=oryx/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:19.359148 19848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:19.360415 19848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:19.373138 19853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:19.373172 19856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:19.373211 19854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:19.373683 19848 server_base.cc:1034] running on GCE node
I20260923 19:42:19.374321 19848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:19.375291 19848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:19.376516 19848 hybrid_clock.cc:648] HybridClock initialized: now 1790192539376474 us; error 57 us; skew 500 ppm
I20260923 19:42:19.376832 19848 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:19 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192539, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:19.379881 19848 init.cc:377] Logged in from keytab as oryx/127.13.88.193@KRBTEST.COM (short username oryx)
I20260923 19:42:19.381222 19848 webserver.cc:460] Webserver started at http://127.13.88.193:33663/ using document root <none> and password file <none>
I20260923 19:42:19.381884 19848 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:19.382036 19848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:19.382339 19848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:19.385205 19848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "955e450bf2014b2ab576b87b2994d231"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "9d0cb92ca603f2ef0071d6e706bb572b"
server_key_iv: "126ca4edc32f352579f27724c11083e4"
server_key_version: "encryptionkey@0"
I20260923 19:42:19.385968 19848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "955e450bf2014b2ab576b87b2994d231"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "9d0cb92ca603f2ef0071d6e706bb572b"
server_key_iv: "126ca4edc32f352579f27724c11083e4"
server_key_version: "encryptionkey@0"
I20260923 19:42:19.391184 19848 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:42:19.395085 19863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:19.396399 19848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:42:19.396565 19848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "955e450bf2014b2ab576b87b2994d231"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "9d0cb92ca603f2ef0071d6e706bb572b"
server_key_iv: "126ca4edc32f352579f27724c11083e4"
server_key_version: "encryptionkey@0"
I20260923 19:42:19.396772 19848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:19.413031 19848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:19.416765 19848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:19.417065 19848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:19.418017 19848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:19.419371 19848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:19.419476 19848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:19.419627 19848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:19.419700 19848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:19.451504 19848 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:43217
I20260923 19:42:19.451543 19975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:43217 every 8 connection(s)
I20260923 19:42:19.452841 19848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:19.457847 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19848
I20260923 19:42:19.458061 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:19.458699 13667 external_mini_cluster.cc:1428] Setting key b72693068c29d8c52a5bfccd2c917d01
Sep 23 19:42:19 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192539, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:19.473510 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:19.455316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:38359 (local address 127.13.88.254:45369)
0923 19:42:19.455749 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:19.455753 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:19.456621 (+ 868us) server_negotiation.cc:407] Connection header received
0923 19:42:19.458488 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:19.458493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:19.458584 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:19.458702 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:19.460548 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.461594 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.463096 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.463821 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.463967 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:19.467754 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:19.467759 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:19.467762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:19.467792 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:19.470270 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:19.471203 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:19.471207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:19.471209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:19.471323 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:19.471813 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:19.471816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:19.471818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:19.472071 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:19.472177 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:19.473081 (+ 904us) server_negotiation.cc:299] Negotiation successful
0923 19:42:19.473248 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":236,"threads_started":1}
I20260923 19:42:19.475073 19979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:19.455776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:38359)
0923 19:42:19.456476 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:19.456515 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:19.458229 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:19.458939 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:19.458947 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:19.459634 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:19.460387 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:19.460412 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.461749 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.461752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:19.462949 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:19.462960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.464012 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.464017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:19.464213 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:19.464879 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:19.464901 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:19.467555 (+ 2654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:19.470417 (+ 2862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:19.470429 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:19.470448 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:19.471071 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:19.471435 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:19.471443 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:19.471450 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:19.471691 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:19.472201 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:19.472211 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:19.472681 (+ 470us) client_negotiation.cc:769] Sending connection context
0923 19:42:19.472976 (+ 295us) client_negotiation.cc:240] Negotiation successful
0923 19:42:19.473566 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":256,"threads_started":1}
I20260923 19:42:19.476855 19976 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45369
I20260923 19:42:19.477182 19976 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:19.477979 19976 heartbeater.cc:511] Master 127.13.88.254:45369 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:42:19.480161 19787 ts_manager.cc:194] Registered new tserver with Master: 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.194@KRBTEST.COM" created.
I20260923 19:42:19.481760 19787 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:38359
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab.
Entry for principal oryx/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab.
I20260923 19:42:19.504271 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45369
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab
--principal=oryx/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:19.814850 19982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:19.815150 19982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:19.815276 19982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:19.822220 19982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:19.822310 19982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:19.822418 19982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:19.831636 19982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab
--principal=oryx/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:19.832855 19982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:19.834160 19982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:19.846915 19987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:19.846874 19988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:19.846957 19990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:19.847913 19982 server_base.cc:1034] running on GCE node
I20260923 19:42:19.848488 19982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:19.849345 19982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:19.850528 19982 hybrid_clock.cc:648] HybridClock initialized: now 1790192539850494 us; error 32 us; skew 500 ppm
I20260923 19:42:19.850826 19982 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:19 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192539, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:19.853840 19982 init.cc:377] Logged in from keytab as oryx/127.13.88.194@KRBTEST.COM (short username oryx)
I20260923 19:42:19.855317 19982 webserver.cc:460] Webserver started at http://127.13.88.194:36297/ using document root <none> and password file <none>
I20260923 19:42:19.855980 19982 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:19.856122 19982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:19.856431 19982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:19.859349 19982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "338f3669b8e2431099b3eaf929a565b0"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "5a8323671251b9f1a80e87f46db0a547"
server_key_iv: "2b78daa4a8892a9587dee979570c960f"
server_key_version: "encryptionkey@0"
I20260923 19:42:19.860113 19982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "338f3669b8e2431099b3eaf929a565b0"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "5a8323671251b9f1a80e87f46db0a547"
server_key_iv: "2b78daa4a8892a9587dee979570c960f"
server_key_version: "encryptionkey@0"
I20260923 19:42:19.865020 19982 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:42:19.868463 19997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:19.869680 19982 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 19:42:19.869851 19982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "338f3669b8e2431099b3eaf929a565b0"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "5a8323671251b9f1a80e87f46db0a547"
server_key_iv: "2b78daa4a8892a9587dee979570c960f"
server_key_version: "encryptionkey@0"
I20260923 19:42:19.870049 19982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:19.882570 19982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:19.886389 19982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:19.886665 19982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:19.887665 19982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:19.888985 19982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:19.889091 19982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:19.889236 19982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:19.889315 19982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:19.921756 19982 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:39403
I20260923 19:42:19.921789 20109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:39403 every 8 connection(s)
I20260923 19:42:19.923013 19982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:19.932412 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 19982
I20260923 19:42:19.932590 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:19.933027 13667 external_mini_cluster.cc:1428] Setting key 70a9094d387b93db8224adde479a8f6d
Sep 23 19:42:19 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192539, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:19.942981 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:19.925601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:33561 (local address 127.13.88.254:45369)
0923 19:42:19.925794 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:19.925800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:19.926961 (+ 1161us) server_negotiation.cc:407] Connection header received
0923 19:42:19.928845 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:19.928850 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:19.928915 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:19.929000 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:19.930447 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.931194 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.932714 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.933186 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.933312 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:19.937377 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:19.937382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:19.937385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:19.937414 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:19.939870 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:19.940750 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:19.940757 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:19.940761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:19.940924 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:19.941277 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:19.941283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:19.941287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:19.941626 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:19.941772 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:19.942328 (+ 556us) server_negotiation.cc:299] Negotiation successful
0923 19:42:19.942553 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:42:19.943621 20112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:19.926122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.194:33561)
0923 19:42:19.926807 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:19.926851 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:19.928610 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:19.929198 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:19.929206 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:19.929668 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:19.930204 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:19.930219 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.931335 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.931339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:19.932563 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:19.932576 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:19.933406 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:19.933412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:19.933717 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:19.934374 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:19.934398 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:19.937179 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:19.940002 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:19.940013 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:19.940031 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:19.940651 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:19.941030 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:19.941033 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:19.941035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:19.941185 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:19.941735 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:19.941740 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:19.942006 (+ 266us) client_negotiation.cc:769] Sending connection context
0923 19:42:19.942209 (+ 203us) client_negotiation.cc:240] Negotiation successful
0923 19:42:19.942539 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":285,"threads_started":1}
I20260923 19:42:19.944933 20110 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45369
I20260923 19:42:19.945204 20110 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:19.945899 20110 heartbeater.cc:511] Master 127.13.88.254:45369 requested a full tablet report, sending...
I20260923 19:42:19.947391 19787 ts_manager.cc:194] Registered new tserver with Master: 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403)
I20260923 19:42:19.948207 19787 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:33561
WARNING: no policy specified for oryx/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab.
Entry for principal oryx/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab.
I20260923 19:42:19.976347 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45369
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab
--principal=oryx/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:20.286835 20115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:20.287181 20115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:20.287353 20115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:20.294284 20115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:20.294394 20115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:20.294574 20115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:20.304075 20115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab
--principal=oryx/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:20.305305 20115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:20.306561 20115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:20.318858 20120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:20.318892 20121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:20.318825 20123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:20.319927 20115 server_base.cc:1034] running on GCE node
I20260923 19:42:20.320497 20115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:20.321328 20115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:20.322544 20115 hybrid_clock.cc:648] HybridClock initialized: now 1790192540322512 us; error 47 us; skew 500 ppm
I20260923 19:42:20.322842 20115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:20 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192540, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:20.325762 20115 init.cc:377] Logged in from keytab as oryx/127.13.88.195@KRBTEST.COM (short username oryx)
I20260923 19:42:20.327227 20115 webserver.cc:460] Webserver started at http://127.13.88.195:39757/ using document root <none> and password file <none>
I20260923 19:42:20.327839 20115 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:20.327929 20115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:20.328155 20115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:20.330686 20115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "cec80cc86c0c4e27882efa0e71b2d7b7"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "cfaf1aefe84c01fe5f021bac46504acc"
server_key_iv: "b3e9a32a645cde28b0c4298877934875"
server_key_version: "encryptionkey@0"
I20260923 19:42:20.331440 20115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "cec80cc86c0c4e27882efa0e71b2d7b7"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "cfaf1aefe84c01fe5f021bac46504acc"
server_key_iv: "b3e9a32a645cde28b0c4298877934875"
server_key_version: "encryptionkey@0"
I20260923 19:42:20.335978 20115 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:42:20.338958 20130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:20.340237 20115 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 19:42:20.340408 20115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "cec80cc86c0c4e27882efa0e71b2d7b7"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "cfaf1aefe84c01fe5f021bac46504acc"
server_key_iv: "b3e9a32a645cde28b0c4298877934875"
server_key_version: "encryptionkey@0"
I20260923 19:42:20.340605 20115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:20.360471 20115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:20.364238 20115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:20.364451 20115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:20.365291 20115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:20.366618 20115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:20.366688 20115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:20.366787 20115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:20.366868 20115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:20.397212 20115 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:46723
I20260923 19:42:20.397248 20242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:46723 every 8 connection(s)
I20260923 19:42:20.398471 20115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:20.403766 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 20115
I20260923 19:42:20.403954 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:20.404350 13667 external_mini_cluster.cc:1428] Setting key e58530c5c2662bd4752831866c7a60e6
Sep 23 19:42:20 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192540, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:20.417359 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.401030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:36489 (local address 127.13.88.254:45369)
0923 19:42:20.401204 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:20.401209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:20.402526 (+ 1317us) server_negotiation.cc:407] Connection header received
0923 19:42:20.404365 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:20.404371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:20.404456 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:20.404580 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:20.406041 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.406871 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.408545 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.408971 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.409098 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.412311 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:20.412316 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:20.412319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:20.412351 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:20.414900 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.415552 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.415556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.415558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.415681 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.416033 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.416036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.416038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.416276 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:20.416384 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:20.416974 (+ 590us) server_negotiation.cc:299] Negotiation successful
0923 19:42:20.417126 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:42:20.418242 20245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.401578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.195:36489)
0923 19:42:20.402329 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:20.402397 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:20.404115 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:20.404796 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:20.404804 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:20.405352 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:20.405887 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.405903 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.407012 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.407023 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.408408 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.408420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.409196 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.409203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.409433 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.410020 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:20.410045 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:20.412133 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:20.415009 (+ 2876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.415015 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.415024 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.415450 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.415773 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.415776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.415778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.415942 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.416375 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:20.416380 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:20.416657 (+ 277us) client_negotiation.cc:769] Sending connection context
0923 19:42:20.416879 (+ 222us) client_negotiation.cc:240] Negotiation successful
0923 19:42:20.417208 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":293,"threads_started":1}
I20260923 19:42:20.419566 20243 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45369
I20260923 19:42:20.419864 20243 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:20.420555 20243 heartbeater.cc:511] Master 127.13.88.254:45369 requested a full tablet report, sending...
I20260923 19:42:20.421835 19786 ts_manager.cc:194] Registered new tserver with Master: cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:20.422643 19786 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:36489
I20260923 19:42:20.431761 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.88.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.253.keytab.
Entry for principal oryx/127.13.88.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.253.keytab.
I20260923 19:42:20.474444 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:46727
--webserver_interface=127.13.88.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.253.keytab
--principal=oryx/127.13.88.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45369,127.13.88.253:46727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:42:20.484542 19976 heartbeater.cc:503] Master 127.13.88.254:45369 was elected leader, sending a full tablet report...
W20260923 19:42:20.788653 20248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:20.788961 20248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:20.789129 20248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:20.796319 20248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:20.796412 20248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:20.796538 20248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:20.796648 20248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:20.796725 20248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:20.806437 20248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45369,127.13.88.253:46727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.253.keytab
--principal=oryx/127.13.88.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:46727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.88.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
W20260923 19:42:20.806792 20248 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.13.88.254:45369,127.13.88.253:46727'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260923 19:42:20.807838 20248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:20.809114 20248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:20.820755 20253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:20.820665 20254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:20.820660 20256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:20.821574 20248 server_base.cc:1034] running on GCE node
I20260923 19:42:20.822297 20248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:20.823855 20248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:20.825100 20248 hybrid_clock.cc:648] HybridClock initialized: now 1790192540825025 us; error 50 us; skew 500 ppm
I20260923 19:42:20.825419 20248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:20 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192540, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:20.828580 20248 init.cc:377] Logged in from keytab as oryx/127.13.88.253@KRBTEST.COM (short username oryx)
I20260923 19:42:20.830101 20248 webserver.cc:460] Webserver started at http://127.13.88.253:33505/ using document root <none> and password file <none>
I20260923 19:42:20.830754 20248 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:20.830899 20248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:20.831284 20248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:20.834097 20248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/instance:
uuid: "d0b1556ecf18479c8a4e4cc101f21866"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "60dec44bd2850538815af0c89d174949"
server_key_iv: "ab40705b518483f73a10d3cc3f6cd298"
server_key_version: "encryptionkey@0"
I20260923 19:42:20.834861 20248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal/instance:
uuid: "d0b1556ecf18479c8a4e4cc101f21866"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "60dec44bd2850538815af0c89d174949"
server_key_iv: "ab40705b518483f73a10d3cc3f6cd298"
server_key_version: "encryptionkey@0"
I20260923 19:42:20.839761 20248 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:42:20.843075 20263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:20.844491 20248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:42:20.844676 20248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
uuid: "d0b1556ecf18479c8a4e4cc101f21866"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "60dec44bd2850538815af0c89d174949"
server_key_iv: "ab40705b518483f73a10d3cc3f6cd298"
server_key_version: "encryptionkey@0"
I20260923 19:42:20.844892 20248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:20.861658 20248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:20.865962 20248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:20.866322 20248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:20.886785 20248 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.253:46727
I20260923 19:42:20.886878 20314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.253:46727 every 8 connection(s)
I20260923 19:42:20.888355 20248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
I20260923 19:42:20.892127 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 20248
I20260923 19:42:20.892246 20315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:20.901882 20315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:42:20 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.253@KRBTEST.COM
Sep 23 19:42:20 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192540, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.253@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:20.916225 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.894212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40388 (local address 127.13.88.253:46727)
0923 19:42:20.895056 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:20.895074 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:20.895148 (+ 74us) server_negotiation.cc:407] Connection header received
0923 19:42:20.897098 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:20.897126 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:20.897620 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:20.898080 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:20.899433 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.901297 (+ 1864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.902508 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.903493 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.903655 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.907921 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:20.907929 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:20.907938 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:20.907979 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:20.910988 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.912192 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.912200 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.912213 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.912421 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.912791 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.912796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.912802 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.913450 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:20.913770 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:20.914532 (+ 762us) server_negotiation.cc:299] Negotiation successful
0923 19:42:20.914936 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":332,"threads_started":1}
I20260923 19:42:20.919492 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.904467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.13.88.254:45369)
0923 19:42:20.904625 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:20.904629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:20.905201 (+ 572us) server_negotiation.cc:407] Connection header received
0923 19:42:20.905393 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:20.905398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:20.905468 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:20.905566 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:20.906567 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.907404 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.908746 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.909158 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.909294 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.912340 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:20.912347 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:20.912360 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:20.912395 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:20.915696 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.916466 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.916471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.916475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.916618 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.917022 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.917025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.917027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.917298 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:20.917434 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:20.918962 (+ 1528us) server_negotiation.cc:299] Negotiation successful
0923 19:42:20.919208 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 19:42:20.919529 20319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.904447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:35594)
0923 19:42:20.905076 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:20.905106 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:20.905272 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:20.905620 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:20.905626 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:20.906173 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:20.906425 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.906432 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.907541 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.907547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.908589 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.908600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.909339 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.909345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.909511 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.910059 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:20.910077 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:20.912165 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:20.915835 (+ 3670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.915843 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.915847 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.916235 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.916743 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.916747 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.916750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.916924 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.918470 (+ 1546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:20.918479 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:20.918683 (+ 204us) client_negotiation.cc:769] Sending connection context
0923 19:42:20.918872 (+ 189us) client_negotiation.cc:240] Negotiation successful
0923 19:42:20.919085 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":331,"threads_started":1}
I20260923 19:42:20.921075 20315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:42:20 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192540, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.253@KRBTEST.COM for oryx/127.13.88.253@KRBTEST.COM
I20260923 19:42:20.932667 20319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.921730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.0.0.1:40404)
0923 19:42:20.921926 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:20.921944 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:20.922035 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:20.922331 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:20.922334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:20.922615 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:20.922730 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.922736 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.924080 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.924084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.924955 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.924969 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.925857 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.925862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.926019 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.926540 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:20.926556 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:20.928445 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:20.930798 (+ 2353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.930802 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.930804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.931185 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.931478 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.931482 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.931484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.931594 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.932041 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:20.932044 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:20.932155 (+ 111us) client_negotiation.cc:769] Sending connection context
0923 19:42:20.932255 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 19:42:20.932440 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":1}
I20260923 19:42:20.932874 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.921764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40404 (local address 127.13.88.253:46727)
0923 19:42:20.921949 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:20.921956 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:20.922000 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:42:20.922137 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:20.922141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:20.922207 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:20.922309 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:20.922859 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.923952 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.925096 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.925715 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.925845 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.928591 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:20.928595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:20.928598 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:20.928623 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:20.930691 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.931273 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.931277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.931279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.931382 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.931674 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.931677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.931679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.931947 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:20.932051 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:20.932337 (+ 286us) server_negotiation.cc:299] Negotiation successful
0923 19:42:20.932547 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":106,"server-negotiator.queue_time_us":83}
I20260923 19:42:20.937219 20315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Bootstrap starting.
I20260923 19:42:20.940168 20315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:20.941147 20315 log.cc:824] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:20.943640 20315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: No bootstrap required, opened a new log
I20260923 19:42:20.950578 20110 heartbeater.cc:503] Master 127.13.88.254:45369 was elected leader, sending a full tablet report...
I20260923 19:42:20.950670 20315 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } }
I20260923 19:42:20.951099 20315 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:20.951232 20315 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0b1556ecf18479c8a4e4cc101f21866, State: Initialized, Role: FOLLOWER
I20260923 19:42:20.951894 20315 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } }
I20260923 19:42:20.952782 20321 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } } }
I20260923 19:42:20.953153 20321 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:20.953685 20315 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:20.957047 20321 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:20.957367 20321 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } }
I20260923 19:42:20.958737 20321 leader_election.cc:288] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369)
I20260923 19:42:20.959539 19797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0b1556ecf18479c8a4e4cc101f21866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134e976966a340ffa2707fe7a13ec7a0" is_pre_election: true
I20260923 19:42:20.960595 20264 leader_election.cc:302] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: d0b1556ecf18479c8a4e4cc101f21866; no voters: 134e976966a340ffa2707fe7a13ec7a0
I20260923 19:42:20.961076 20321 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:42:20.963186 20332 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:42:20.963335 20332 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:42:20.965273 20248 master_runner.cc:428] Detected that this master d0b1556ecf18479c8a4e4cc101f21866 is joining an existing cluster
I20260923 19:42:20.965368 20248 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.88.253:46727
I20260923 19:42:20.987600 20338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.969388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.0.0.1:40412)
0923 19:42:20.969973 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:20.969991 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:20.970153 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:20.970924 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:20.970930 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:20.971718 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:20.972187 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.972202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.973974 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.973982 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.975648 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.975663 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.976934 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.976942 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.977147 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.977805 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:20.977830 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:20.978833 (+ 1003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:20.984470 (+ 5637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.984477 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.984487 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.985011 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.985406 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.985414 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.985420 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.985584 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.986229 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:20.986237 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:20.986405 (+ 168us) client_negotiation.cc:769] Sending connection context
0923 19:42:20.986541 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 19:42:20.986951 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":638,"threads_started":1}
I20260923 19:42:20.988637 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.969351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40412 (local address 127.13.88.253:46727)
0923 19:42:20.969541 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:20.969550 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:20.970055 (+ 505us) server_negotiation.cc:407] Connection header received
0923 19:42:20.970306 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:20.970313 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:20.970386 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:20.970454 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:20.972367 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.973676 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.975775 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.976529 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.976636 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.978998 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:20.979004 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:20.979009 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:20.979042 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:20.984340 (+ 5298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.985153 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.985160 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.985166 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.985297 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.985701 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.985708 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.985714 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.986110 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:20.987896 (+ 1786us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:20.988020 (+ 124us) server_negotiation.cc:299] Negotiation successful
0923 19:42:20.988219 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:42:20.994545 20339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.971044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:35602)
0923 19:42:20.979142 (+ 8098us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:20.979161 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:20.979351 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:20.979881 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:20.979886 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:20.980620 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:20.980967 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.980982 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.982508 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.982514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.984237 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:20.984252 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.985537 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.985544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:20.985707 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.986314 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:20.986364 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:20.987705 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:20.991644 (+ 3939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.991648 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.991652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.992140 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.992606 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:20.992611 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:20.992615 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:20.992772 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:20.993435 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:20.993441 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:20.993633 (+ 192us) client_negotiation.cc:769] Sending connection context
0923 19:42:20.993790 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 19:42:20.994061 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7947,"spinlock_wait_cycles":2304,"thread_start_us":6662,"threads_started":1}
I20260923 19:42:20.994622 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:20.970519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35602 (local address 127.13.88.254:45369)
0923 19:42:20.970680 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:20.970687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:20.979231 (+ 8544us) server_negotiation.cc:407] Connection header received
0923 19:42:20.979501 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:20.979508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:20.979592 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:20.979666 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:20.981124 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.982345 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.984426 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:20.985096 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:20.985236 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:20.987923 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:20.987931 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:20.987936 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:20.987975 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:20.991478 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.992291 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.992300 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.992305 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.992472 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:20.992909 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:20.992917 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:20.992921 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:20.993303 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:20.993455 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:20.993983 (+ 528us) server_negotiation.cc:299] Negotiation successful
0923 19:42:20.994242 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
WARNING: no policy specified for oryx/127.13.88.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.252@KRBTEST.COM" created.
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.254@KRBTEST.COM for oryx/127.13.88.253@KRBTEST.COM
I20260923 19:42:21.022217 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.001393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40426 (local address 127.13.88.253:46727)
0923 19:42:21.001556 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.001561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.003875 (+ 2314us) server_negotiation.cc:407] Connection header received
0923 19:42:21.004217 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.004225 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.004348 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.004447 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.005781 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.006855 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.008726 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.009571 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.009708 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.014017 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.014024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.014029 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.014084 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.019060 (+ 4976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.019995 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.019999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.020001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.020144 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.020613 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.020618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.020622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.020922 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.021075 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.021565 (+ 490us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.021789 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:42:21.022253 20341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.001255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.0.0.1:40426)
0923 19:42:21.003750 (+ 2495us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.003790 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.004003 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.004516 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.004524 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.005339 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.005617 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.005630 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.006985 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.006992 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.008572 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.008588 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.009743 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.009750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.009952 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.010639 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.010667 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.013794 (+ 3127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.019227 (+ 5433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.019242 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.019251 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.019865 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.020337 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.020342 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.020346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.020488 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.021064 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.021074 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.021268 (+ 194us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.021460 (+ 192us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.021789 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2243,"thread_start_us":1952,"threads_started":1}
I20260923 19:42:21.024518 19786 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.88.253:46727: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866"
member_type: NON_VOTER
last_known_addr {
host: "127.13.88.253"
port: 46727
}
attrs {
promote: true
}
}
dest_uuid: "134e976966a340ffa2707fe7a13ec7a0"
cas_config_opid_index: -1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.252.keytab.
Entry for principal oryx/127.13.88.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.252.keytab.
I20260923 19:42:21.025735 19786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } }
I20260923 19:42:21.026459 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:46359
--webserver_interface=127.13.88.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.252.keytab
--principal=oryx/127.13.88.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:42:21.041070 20290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:21.044826 20290 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Refusing update from remote peer 134e976966a340ffa2707fe7a13ec7a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260923 19:42:21.054265 20345 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:21.054179 20347 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER d0b1556ecf18479c8a4e4cc101f21866 (127.13.88.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.058861 20347 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.88.253:46727
I20260923 19:42:21.059587 20248 master.cc:537] Master@127.13.88.253:46727 shutting down...
I20260923 19:42:21.060727 20347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.060972 20347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:21.095414 20290 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER d0b1556ecf18479c8a4e4cc101f21866 (127.13.88.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.107419 20321 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 134e976966a340ffa2707fe7a13ec7a0. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.107697 20321 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:42:21.107666 20351 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.107973 20351 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:42:21.108237 20355 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.108765 20355 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:42:21.109676 20248 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 LEARNER]: Raft consensus shutting down.
I20260923 19:42:21.110069 20248 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 LEARNER]: Raft consensus is shut down!
I20260923 19:42:21.110239 20248 tablet_replica.cc:330] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: stopping tablet replica
I20260923 19:42:21.127537 20248 master.cc:552] Master@127.13.88.253:46727 shutdown complete.
I20260923 19:42:21.127653 20248 master_runner.cc:305] Clearing existing system tablet
I20260923 19:42:21.128028 20248 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:21.128136 20248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:21.130491 20248 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260923 19:42:21.132296 20357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:21.132611 20248 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:21.132894 20248 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260923 19:42:21.132977 20248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
uuid: "d0b1556ecf18479c8a4e4cc101f21866"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "60dec44bd2850538815af0c89d174949"
server_key_iv: "ab40705b518483f73a10d3cc3f6cd298"
server_key_version: "encryptionkey@0"
I20260923 19:42:21.136087 20248 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:21.140673 20248 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 19:42:21.140870 20248 log.cc:1196] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260923 19:42:21.141366 20248 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Deleting consensus metadata
I20260923 19:42:21.141626 20248 master_runner.cc:315] Copying system tablet from 127.13.88.254:45369
I20260923 19:42:21.144135 20248 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: tablet copy: Beginning tablet copy session from remote peer at address 127.13.88.254:45369
I20260923 19:42:21.158016 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.144970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35618 (local address 127.13.88.254:45369)
0923 19:42:21.145186 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.145196 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.145744 (+ 548us) server_negotiation.cc:407] Connection header received
0923 19:42:21.145960 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.145967 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.146052 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.146164 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.146977 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.147774 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.149023 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.149440 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.149573 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.152194 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.152201 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.152206 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.152244 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.155301 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.155979 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.155986 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.155989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.156134 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.156506 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.156512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.156516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.156856 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.157044 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.157437 (+ 393us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.157654 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:42:21.158114 20363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.144951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:35618)
0923 19:42:21.145629 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.145648 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.145813 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.146188 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.146192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.146610 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.146811 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.146819 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.147937 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.147942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.148879 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.148890 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.149611 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.149618 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.149794 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.151213 (+ 1419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.151236 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.152001 (+ 765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.155421 (+ 3420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.155428 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.155432 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.155828 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.156248 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.156252 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.156256 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.156385 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.156971 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.156976 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.157173 (+ 197us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.157329 (+ 156us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.157628 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":422,"threads_started":1}
I20260923 19:42:21.159204 19807 tablet_copy_service.cc:140] P 134e976966a340ffa2707fe7a13ec7a0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d0b1556ecf18479c8a4e4cc101f21866 ({username='oryx', principal='oryx/127.13.88.253@KRBTEST.COM'} at 127.0.0.1:35618)
I20260923 19:42:21.159497 19807 tablet_copy_service.cc:161] P 134e976966a340ffa2707fe7a13ec7a0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d0b1556ecf18479c8a4e4cc101f21866 at {username='oryx', principal='oryx/127.13.88.253@KRBTEST.COM'} at 127.0.0.1:35618: session id = d0b1556ecf18479c8a4e4cc101f21866-00000000000000000000000000000000
I20260923 19:42:21.163929 19807 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 19:42:21.166301 20248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 19:42:21.173472 20248 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: tablet copy: Starting download of 0 data blocks...
I20260923 19:42:21.173786 20248 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: tablet copy: Starting download of 1 WAL segments...
I20260923 19:42:21.176538 20248 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 19:42:21.181022 19807 tablet_copy_service.cc:342] P 134e976966a340ffa2707fe7a13ec7a0: Request end of tablet copy session d0b1556ecf18479c8a4e4cc101f21866-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.88.253@KRBTEST.COM'} at 127.0.0.1:35618
I20260923 19:42:21.181208 19807 tablet_copy_service.cc:433] P 134e976966a340ffa2707fe7a13ec7a0: ending tablet copy session d0b1556ecf18479c8a4e4cc101f21866-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d0b1556ecf18479c8a4e4cc101f21866
I20260923 19:42:21.192047 20248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:21.194446 20364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:21.200596 20365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:21.204957 20367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:21.207581 20248 server_base.cc:1034] running on GCE node
I20260923 19:42:21.207906 20248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:21.208520 20248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:21.209721 20248 hybrid_clock.cc:648] HybridClock initialized: now 1790192541209652 us; error 48 us; skew 500 ppm
I20260923 19:42:21.209932 20248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192541, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:21.211849 20248 init.cc:377] Logged in from keytab as oryx/127.13.88.253@KRBTEST.COM (short username oryx)
I20260923 19:42:21.215955 20248 webserver.cc:460] Webserver started at http://127.13.88.253:34323/ using document root <none> and password file <none>
I20260923 19:42:21.216274 20248 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:21.216364 20248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:21.218647 20248 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260923 19:42:21.220278 20374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:21.220713 20248 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260923 19:42:21.220856 20248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
uuid: "d0b1556ecf18479c8a4e4cc101f21866"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "60dec44bd2850538815af0c89d174949"
server_key_iv: "ab40705b518483f73a10d3cc3f6cd298"
server_key_version: "encryptionkey@0"
I20260923 19:42:21.221016 20248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:21.237191 20248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:21.240689 20248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:21.274816 20248 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.253:46727
I20260923 19:42:21.274847 20425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.253:46727 every 8 connection(s)
I20260923 19:42:21.275676 20248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
I20260923 19:42:21.282616 20426 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:42:21.285090 20426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Bootstrap starting.
I20260923 19:42:21.295033 20426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:42:21.295506 20426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: Bootstrap complete.
I20260923 19:42:21.296308 20426 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } }
I20260923 19:42:21.296554 20426 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d0b1556ecf18479c8a4e4cc101f21866, State: Initialized, Role: LEARNER
I20260923 19:42:21.296800 20426 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } }
I20260923 19:42:21.297569 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.297910 20426 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:21.297966 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:42:21.313310 20440 catalog_manager.cc:1259] Loaded cluster ID: 75b8dfb7ff384dec9a9e6003b2797e82
I20260923 19:42:21.313424 20440 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: loading cluster ID for follower catalog manager: success
I20260923 19:42:21.317023 20440 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: acquiring CA information for follower catalog manager: success
I20260923 19:42:21.319623 20440 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:42:21.425034 20243 heartbeater.cc:503] Master 127.13.88.254:45369 was elected leader, sending a full tablet report...
W20260923 19:42:21.444301 20346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:21.444547 20346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:21.444700 20346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:21.451757 20346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:21.451850 20346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:21.451934 20346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:21.452032 20346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:21.452095 20346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:21.461892 20346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.252.keytab
--principal=oryx/127.13.88.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:46359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.88.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:21.463286 20346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:21.464598 20346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:21.476999 20445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:21.476914 20448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:21.476961 20446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:21.478021 20346 server_base.cc:1034] running on GCE node
I20260923 19:42:21.478694 20346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:21.480060 20346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:21.481251 20346 hybrid_clock.cc:648] HybridClock initialized: now 1790192541481217 us; error 26 us; skew 500 ppm
I20260923 19:42:21.481542 20346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192541, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:21.484505 20346 init.cc:377] Logged in from keytab as oryx/127.13.88.252@KRBTEST.COM (short username oryx)
I20260923 19:42:21.485901 20346 webserver.cc:460] Webserver started at http://127.13.88.252:35007/ using document root <none> and password file <none>
I20260923 19:42:21.486756 20346 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:21.486930 20346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:21.487310 20346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:21.490325 20346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/instance:
uuid: "2c2f3245d88c48cfb18ec735d416034e"
format_stamp: "Formatted at 2026-09-23 19:42:21 on dist-test-slave-xg7f"
server_key: "5bf17e1f59630b32b331fc28e75e379c"
server_key_iv: "7f4f1dc2a2c491fc31be5b8dc7a178a4"
server_key_version: "encryptionkey@0"
I20260923 19:42:21.491083 20346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal/instance:
uuid: "2c2f3245d88c48cfb18ec735d416034e"
format_stamp: "Formatted at 2026-09-23 19:42:21 on dist-test-slave-xg7f"
server_key: "5bf17e1f59630b32b331fc28e75e379c"
server_key_iv: "7f4f1dc2a2c491fc31be5b8dc7a178a4"
server_key_version: "encryptionkey@0"
I20260923 19:42:21.495934 20346 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:42:21.499171 20455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:21.500476 20346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:42:21.500633 20346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
uuid: "2c2f3245d88c48cfb18ec735d416034e"
format_stamp: "Formatted at 2026-09-23 19:42:21 on dist-test-slave-xg7f"
server_key: "5bf17e1f59630b32b331fc28e75e379c"
server_key_iv: "7f4f1dc2a2c491fc31be5b8dc7a178a4"
server_key_version: "encryptionkey@0"
I20260923 19:42:21.500782 20346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:21.522627 20346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:21.526294 20346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:21.526559 20346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:21.529973 20345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.530292 20345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:21.538056 20462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.530207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.0.0.1:50750)
0923 19:42:21.530870 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.530891 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.531034 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.531835 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.531843 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.531878 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:21.532095 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.532105 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.533889 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.533896 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.535665 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.535685 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.537153 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.537159 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.537391 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.537454 (+ 63us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.537574 (+ 120us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.537711 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":400,"threads_started":1}
I20260923 19:42:21.538070 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.530402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50750 (local address 127.13.88.253:46727)
0923 19:42:21.531487 (+ 1085us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.531492 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.531506 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:42:21.531565 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.531568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.531630 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.531785 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:21.532242 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.533700 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.535831 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.536978 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.537113 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.537350 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.537600 (+ 250us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.537724 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":978,"thread_start_us":840,"threads_started":1}
I20260923 19:42:21.539728 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 134e976966a340ffa2707fe7a13ec7a0. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.540022 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: LEARNER
I20260923 19:42:21.540395 20345 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: attempting to promote NON_VOTER d0b1556ecf18479c8a4e4cc101f21866 to VOTER
I20260923 19:42:21.541267 20345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } }
I20260923 19:42:21.543185 20401 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 LEARNER]: Refusing update from remote peer 134e976966a340ffa2707fe7a13ec7a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260923 19:42:21.543814 20347 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260923 19:42:21.546764 20345 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d0b1556ecf18479c8a4e4cc101f21866 (127.13.88.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } }
I20260923 19:42:21.547204 20346 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.252:46359
I20260923 19:42:21.547209 20509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.252:46359 every 8 connection(s)
I20260923 19:42:21.547489 20401 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, d0b1556ecf18479c8a4e4cc101f21866 (127.13.88.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } }
I20260923 19:42:21.548576 20346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
I20260923 19:42:21.550668 20347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } }
I20260923 19:42:21.550916 20347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:21.551367 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } }
I20260923 19:42:21.551461 20345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } }
I20260923 19:42:21.551578 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:21.551625 20345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:21.553906 20510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:21.558133 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 20346
I20260923 19:42:21.562101 20510 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.252@KRBTEST.COM
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192541, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.252@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:21.580111 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.565093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34066 (local address 127.13.88.254:45369)
0923 19:42:21.565300 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.565309 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.565908 (+ 599us) server_negotiation.cc:407] Connection header received
0923 19:42:21.566074 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.566078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.566138 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.566217 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.567512 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.568220 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.570058 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.570497 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.570627 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.574081 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.574087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.574090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.574118 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.577000 (+ 2882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.577853 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.577860 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.577865 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.578018 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.578373 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.578378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.578381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.578730 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.578875 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.579520 (+ 645us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.579746 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:42:21.580767 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.560383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47696 (local address 127.13.88.252:46359)
0923 19:42:21.561087 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.561098 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.561135 (+ 37us) server_negotiation.cc:407] Connection header received
0923 19:42:21.562659 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.562679 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.563054 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.563471 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.564857 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.566980 (+ 2123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.568246 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.569135 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.569341 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.573769 (+ 4428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.573783 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.573795 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.573828 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.576569 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.577287 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.577293 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.577295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.577443 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.577881 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.577885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.577888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.578529 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.578829 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.579246 (+ 417us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.579666 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":510,"thread_start_us":312,"threads_started":1}
I20260923 19:42:21.580812 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.565009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34066)
0923 19:42:21.565744 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.565792 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.565962 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.566314 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.566320 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.567140 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.567378 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.567386 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.568352 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.568361 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.569629 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.569641 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.570717 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.570725 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.570915 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.571496 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.571519 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.573901 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.577152 (+ 3251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.577165 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.577176 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.577723 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.578128 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.578132 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.578134 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.578255 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.578873 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.578881 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.579126 (+ 245us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.579410 (+ 284us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.579799 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":82,"spinlock_wait_cycles":19840,"thread_start_us":345,"threads_started":1}
I20260923 19:42:21.582314 20510 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192541, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.252@KRBTEST.COM for oryx/127.13.88.253@KRBTEST.COM
I20260923 19:42:21.593672 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.583090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.0.0.1:50762)
0923 19:42:21.583283 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.583304 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.583392 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.583673 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.583676 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.584028 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.584152 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.584160 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.585105 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.585109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.585977 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.585993 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.586646 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.586650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.586770 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.587382 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.587399 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.589177 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.591881 (+ 2704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.591884 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.591887 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.592217 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.592516 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.592519 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.592521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.592632 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.593034 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.593036 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.593149 (+ 113us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.593246 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.593429 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260923 19:42:21.593727 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.583170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50762 (local address 127.13.88.253:46727)
0923 19:42:21.583381 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.583391 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.583413 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:42:21.583477 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.583482 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.583557 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.583666 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.584286 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.584991 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.586094 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.586512 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.586600 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.589343 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.589348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.589351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.589378 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.591760 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.592308 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.592311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.592314 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.592432 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.592713 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.592716 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.592718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.592947 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.593048 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.593318 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.593474 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:42:21.594736 20510 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192541, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.252@KRBTEST.COM for oryx/127.13.88.252@KRBTEST.COM
I20260923 19:42:21.605947 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.595549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.0.0.1:47698)
0923 19:42:21.595672 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.595688 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.595806 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.596068 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.596072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.596395 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.596523 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.596530 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.597425 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.597430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.598213 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.598223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.598884 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.598890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.599067 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.599553 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.599568 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.601479 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.603954 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.603971 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.603973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.604361 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.604649 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.604652 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.604654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.604854 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.605275 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.605278 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.605384 (+ 106us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.605515 (+ 131us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.605676 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260923 19:42:21.606019 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.595502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47698 (local address 127.13.88.252:46359)
0923 19:42:21.595673 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.595679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.595756 (+ 77us) server_negotiation.cc:407] Connection header received
0923 19:42:21.595907 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.595912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.595964 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.596055 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.596641 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.597291 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.598345 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.598737 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.598871 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.601628 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.601633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.601636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.601661 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.603852 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.604452 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.604456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.604458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.604560 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.604941 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.604944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.604946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.605167 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.605284 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.605587 (+ 303us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.605776 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":49}
I20260923 19:42:21.610500 20510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Bootstrap starting.
I20260923 19:42:21.613524 20510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:21.614488 20510 log.cc:824] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:21.616932 20510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: No bootstrap required, opened a new log
I20260923 19:42:21.623616 20510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } }
I20260923 19:42:21.623924 20510 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:21.624027 20510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c2f3245d88c48cfb18ec735d416034e, State: Initialized, Role: FOLLOWER
I20260923 19:42:21.624557 20510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } }
I20260923 19:42:21.625345 20516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } } }
I20260923 19:42:21.625620 20516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:21.626278 20510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:42:21.634354 20527 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:42:21.634485 20527 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:42:21.635555 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19848
I20260923 19:42:21.638595 20346 master_runner.cc:428] Detected that this master 2c2f3245d88c48cfb18ec735d416034e is joining an existing cluster
I20260923 19:42:21.638718 20346 master_runner.cc:432] Initiating AddMaster RPC to add 127.13.88.252:46359
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.193@KRBTEST.COM
I20260923 19:42:21.658664 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.636455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53248 (local address 127.13.88.193:43217)
0923 19:42:21.637006 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.637015 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.637042 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:42:21.637109 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.637116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.637363 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.637528 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.638990 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.640593 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.642533 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.643476 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.643630 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.650054 (+ 6424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.650069 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.650087 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.650130 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.654397 (+ 4267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.655348 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.655360 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.655365 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.655504 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.655995 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.655999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.656002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.656398 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.657834 (+ 1436us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.658000 (+ 166us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.658253 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":558,"threads_started":1}
I20260923 19:42:21.659427 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.642990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34068 (local address 127.13.88.254:45369)
0923 19:42:21.643297 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.643305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.643830 (+ 525us) server_negotiation.cc:407] Connection header received
0923 19:42:21.644099 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.644107 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.644192 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.644300 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.645410 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.646118 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.647484 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.647909 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.648043 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.652860 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.652868 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.652874 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.652915 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.656318 (+ 3403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.657100 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.657105 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.657108 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.657255 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.657765 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.657770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.657773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.658121 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.658245 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.658829 (+ 584us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.659079 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260923 19:42:21.660077 19971 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:21.661154 20535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.642390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34068)
0923 19:42:21.643716 (+ 1326us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.643740 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.643946 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.644322 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.644327 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.645006 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.645262 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.645271 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.646246 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.646253 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.647348 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.647360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.648084 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.648090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.648246 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.648936 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.648962 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.652641 (+ 3679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.656483 (+ 3842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.656488 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.656493 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.656979 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.657414 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.657418 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.657422 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.657631 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.658338 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.658343 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.658541 (+ 198us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.660047 (+ 1506us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.660489 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1203,"thread_start_us":8182,"threads_started":1}
I20260923 19:42:21.664975 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.649652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47712 (local address 127.13.88.252:46359)
0923 19:42:21.650052 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.650061 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.650574 (+ 513us) server_negotiation.cc:407] Connection header received
0923 19:42:21.650772 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.650777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.650843 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.650903 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.652277 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.653385 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.655239 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.655873 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.655969 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.658417 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.658424 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.658428 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.658466 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.661938 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.662602 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.662610 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.662616 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.662783 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.663253 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.663258 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.663260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.663665 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.663794 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.664315 (+ 521us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.664555 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260923 19:42:21.675649 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.649781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.0.0.1:47712)
0923 19:42:21.650497 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.650514 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.650653 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.651054 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.651058 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.651787 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.652132 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.652147 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.653600 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.653603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.655075 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.655094 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.656235 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.656242 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.656404 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.657038 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.657060 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.658219 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.662070 (+ 3851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.662076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.662080 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.662480 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.662905 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.662909 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.662912 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.663091 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.663877 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.663882 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.664054 (+ 172us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.665414 (+ 1360us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.666946 (+ 1532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":953,"threads_started":1}
I20260923 19:42:21.680855 20463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.643025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50778 (local address 127.13.88.253:46727)
0923 19:42:21.643471 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.643476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.650450 (+ 6974us) server_negotiation.cc:407] Connection header received
0923 19:42:21.650678 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.650686 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.650771 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.650873 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.652588 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.653640 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.661155 (+ 7515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.661810 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.661937 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.668055 (+ 6118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.668062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.668066 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.668105 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.671587 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.674065 (+ 2478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.674070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.674074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.674215 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.674797 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.674802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.674806 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.675177 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.675320 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.680214 (+ 4894us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.680481 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300}
I20260923 19:42:21.681900 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.643152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.0.0.1:50778)
0923 19:42:21.650345 (+ 7193us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.650363 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.650496 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.651229 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.651234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.652010 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.652441 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.652459 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.659217 (+ 6758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.659224 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.660962 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.660977 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.663213 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.663224 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.663758 (+ 534us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.664940 (+ 1182us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.664966 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.667842 (+ 2876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.671740 (+ 3898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.671749 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.671756 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.673922 (+ 2166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.674407 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.674412 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.674416 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.674614 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.675507 (+ 893us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.675512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.679888 (+ 4376us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.681120 (+ 1232us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.681462 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7049,"thread_start_us":301,"threads_started":1}
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.254@KRBTEST.COM for oryx/127.13.88.252@KRBTEST.COM
I20260923 19:42:21.692538 20462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.667053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.0.0.1:47722)
0923 19:42:21.667292 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.667310 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.667409 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.668003 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.668010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.668617 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.668845 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.668860 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.675015 (+ 6155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.675024 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.677049 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.677070 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.680723 (+ 3653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.680730 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.680896 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.681839 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.681866 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.685302 (+ 3436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.689836 (+ 4534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.689841 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.689845 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.690368 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.690758 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.690763 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.690767 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.690912 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.691562 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.691569 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.691754 (+ 185us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.691909 (+ 155us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.692177 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260923 19:42:21.692571 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.667370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47722 (local address 127.13.88.252:46359)
0923 19:42:21.667555 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.667560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.667577 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:42:21.667682 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.667689 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.667817 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.669016 (+ 1199us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.669230 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.674809 (+ 5579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.677640 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.680538 (+ 2898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.683610 (+ 3072us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.685522 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.685531 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.685537 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.685577 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.689705 (+ 4128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.690502 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.690507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.690511 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.690632 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.691029 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.691034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.691037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.691412 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.691533 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.692030 (+ 497us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.692238 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:42:21.694442 19786 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.13.88.252:46359: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e"
member_type: NON_VOTER
last_known_addr {
host: "127.13.88.252"
port: 46359
}
attrs {
promote: true
}
}
dest_uuid: "134e976966a340ffa2707fe7a13ec7a0"
cas_config_opid_index: 6
I20260923 19:42:21.695295 19786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } }
I20260923 19:42:21.697576 20401 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Refusing update from remote peer 134e976966a340ffa2707fe7a13ec7a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260923 19:42:21.697852 20484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:21.698247 20347 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260923 19:42:21.700760 20347 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 2c2f3245d88c48cfb18ec735d416034e (127.13.88.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:21.701598 20484 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 FOLLOWER]: Refusing update from remote peer 134e976966a340ffa2707fe7a13ec7a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260923 19:42:21.703284 20344 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:21.704965 20401 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 2c2f3245d88c48cfb18ec735d416034e (127.13.88.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:21.708626 20347 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.13.88.252:46359
I20260923 19:42:21.709311 20346 master.cc:537] Master@127.13.88.252:46359 shutting down...
I20260923 19:42:21.710351 20347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:21.710596 20347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:21.710824 20344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:21.711035 20344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:21.711479 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:21.711743 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:21.724203 20484 raft_consensus.cc:858] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } }
W20260923 19:42:21.724382 20484 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } }
I20260923 19:42:21.752589 20484 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER d0b1556ecf18479c8a4e4cc101f21866 (127.13.88.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.757150 20543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.757522 20543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260923 19:42:21.757486 20540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.757849 20540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260923 19:42:21.757912 20516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 134e976966a340ffa2707fe7a13ec7a0. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: NON_VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: true } } }
I20260923 19:42:21.758105 20516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260923 19:42:21.759629 20347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:21.759872 20347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
W20260923 19:42:21.760505 19774 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260923 19:42:21.762264 19774 consensus_peers.cc:487] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 -> Peer 2c2f3245d88c48cfb18ec735d416034e (127.13.88.252:46359): Couldn't send request to peer 2c2f3245d88c48cfb18ec735d416034e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:42:21.762305 20346 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260923 19:42:21.762722 20346 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260923 19:42:21.762917 20346 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: stopping tablet replica
I20260923 19:42:21.778998 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19848
I20260923 19:42:21.780727 20346 master.cc:552] Master@127.13.88.252:46359 shutdown complete.
I20260923 19:42:21.780895 20346 master_runner.cc:305] Clearing existing system tablet
I20260923 19:42:21.781358 20346 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:21.781533 20346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:21.786502 20346 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:42:21.788564 20546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:21.788910 20346 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:21.789389 20346 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 19:42:21.789546 20346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
uuid: "2c2f3245d88c48cfb18ec735d416034e"
format_stamp: "Formatted at 2026-09-23 19:42:21 on dist-test-slave-xg7f"
server_key: "5bf17e1f59630b32b331fc28e75e379c"
server_key_iv: "7f4f1dc2a2c491fc31be5b8dc7a178a4"
server_key_version: "encryptionkey@0"
I20260923 19:42:21.795420 20346 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:21.801856 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:43217
--local_ip_for_outbound_sockets=127.13.88.193
--tserver_master_addrs=127.13.88.254:45369
--webserver_port=33663
--webserver_interface=127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab
--principal=oryx/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:42:21.803447 20346 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 19:42:21.803618 20346 log.cc:1196] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260923 19:42:21.804137 20346 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Deleting consensus metadata
I20260923 19:42:21.804581 20346 master_runner.cc:315] Copying system tablet from 127.13.88.254:45369
I20260923 19:42:21.809782 20346 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: tablet copy: Beginning tablet copy session from remote peer at address 127.13.88.254:45369
I20260923 19:42:21.828481 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.810775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34072 (local address 127.13.88.254:45369)
0923 19:42:21.811038 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:21.811047 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:21.811294 (+ 247us) server_negotiation.cc:407] Connection header received
0923 19:42:21.811485 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:21.811495 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:21.811598 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:21.811710 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:21.813020 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.814229 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.816527 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.817288 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.817418 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.820229 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:21.820236 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:21.820242 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:21.820285 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:21.824457 (+ 4172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.825384 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.825392 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.825398 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.825560 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:21.826090 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:21.826098 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:21.826137 (+ 39us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:21.826585 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:21.826760 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:21.827497 (+ 737us) server_negotiation.cc:299] Negotiation successful
0923 19:42:21.827875 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260923 19:42:21.829641 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:21.810609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34072)
0923 19:42:21.811174 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:21.811195 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:21.811355 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:21.811914 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:21.811922 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:21.812529 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:21.812841 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.812858 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.814449 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.814456 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.816367 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:21.816383 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:21.817702 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:21.817710 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:21.817919 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:21.818676 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:21.818704 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:21.820008 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:21.824651 (+ 4643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.824657 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.824663 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.825202 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.825714 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:21.825720 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:21.825726 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:21.825951 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:21.826851 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:21.826858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:21.827125 (+ 267us) client_negotiation.cc:769] Sending connection context
0923 19:42:21.828769 (+ 1644us) client_negotiation.cc:240] Negotiation successful
0923 19:42:21.829156 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":272,"threads_started":1}
I20260923 19:42:21.830204 19807 tablet_copy_service.cc:140] P 134e976966a340ffa2707fe7a13ec7a0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2c2f3245d88c48cfb18ec735d416034e ({username='oryx', principal='oryx/127.13.88.252@KRBTEST.COM'} at 127.0.0.1:34072)
I20260923 19:42:21.830368 19807 tablet_copy_service.cc:161] P 134e976966a340ffa2707fe7a13ec7a0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2c2f3245d88c48cfb18ec735d416034e at {username='oryx', principal='oryx/127.13.88.252@KRBTEST.COM'} at 127.0.0.1:34072: session id = 2c2f3245d88c48cfb18ec735d416034e-00000000000000000000000000000000
I20260923 19:42:21.834203 19807 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 19:42:21.835904 20346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 19:42:21.842511 20346 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: tablet copy: Starting download of 0 data blocks...
I20260923 19:42:21.842826 20346 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: tablet copy: Starting download of 1 WAL segments...
I20260923 19:42:21.844988 20346 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 19:42:21.848735 19807 tablet_copy_service.cc:342] P 134e976966a340ffa2707fe7a13ec7a0: Request end of tablet copy session 2c2f3245d88c48cfb18ec735d416034e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.13.88.252@KRBTEST.COM'} at 127.0.0.1:34072
I20260923 19:42:21.848860 19807 tablet_copy_service.cc:433] P 134e976966a340ffa2707fe7a13ec7a0: ending tablet copy session 2c2f3245d88c48cfb18ec735d416034e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2c2f3245d88c48cfb18ec735d416034e
I20260923 19:42:21.859187 20346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:21.861744 20554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:21.864327 20555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:21.873549 20346 server_base.cc:1034] running on GCE node
W20260923 19:42:21.874243 20558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:21.874687 20346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:21.875402 20346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:21.876588 20346 hybrid_clock.cc:648] HybridClock initialized: now 1790192541876550 us; error 33 us; skew 500 ppm
I20260923 19:42:21.876873 20346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:21 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192541, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:21.878952 20346 init.cc:377] Logged in from keytab as oryx/127.13.88.252@KRBTEST.COM (short username oryx)
I20260923 19:42:21.883993 20346 webserver.cc:460] Webserver started at http://127.13.88.252:34209/ using document root <none> and password file <none>
I20260923 19:42:21.884317 20346 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:21.884451 20346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:21.887576 20346 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260923 19:42:21.889633 20564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:21.890048 20346 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260923 19:42:21.890189 20346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
uuid: "2c2f3245d88c48cfb18ec735d416034e"
format_stamp: "Formatted at 2026-09-23 19:42:21 on dist-test-slave-xg7f"
server_key: "5bf17e1f59630b32b331fc28e75e379c"
server_key_iv: "7f4f1dc2a2c491fc31be5b8dc7a178a4"
server_key_version: "encryptionkey@0"
I20260923 19:42:21.890383 20346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:21.931915 20346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:21.935720 20346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:21.972366 20346 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.252:46359
I20260923 19:42:21.972417 20615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.252:46359 every 8 connection(s)
I20260923 19:42:21.973444 20346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
I20260923 19:42:21.979264 20616 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:42:21.983155 20616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Bootstrap starting.
I20260923 19:42:21.999964 20616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:42:22.000495 20616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Bootstrap complete.
I20260923 19:42:22.001542 20616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } }
I20260923 19:42:22.001833 20616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2c2f3245d88c48cfb18ec735d416034e, State: Initialized, Role: LEARNER
I20260923 19:42:22.002079 20616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } }
I20260923 19:42:22.003214 20616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:22.002925 20619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:22.003476 20619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: LEARNER
I20260923 19:42:22.016026 20630 catalog_manager.cc:1259] Loaded cluster ID: 75b8dfb7ff384dec9a9e6003b2797e82
I20260923 19:42:22.016140 20630 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: loading cluster ID for follower catalog manager: success
I20260923 19:42:22.019709 20630 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: acquiring CA information for follower catalog manager: success
I20260923 19:42:22.022320 20630 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:42:22.148511 20347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:22.148871 20347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:22.155730 20462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.148892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.0.0.1:47734)
0923 19:42:22.149172 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:22.149195 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:22.149363 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:22.150034 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:22.150038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:22.150071 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:22.150213 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.150221 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.152286 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.152294 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.153459 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.153472 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.155013 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.155022 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.155253 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.155308 (+ 55us) client_negotiation.cc:769] Sending connection context
0923 19:42:22.155393 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 19:42:22.155499 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260923 19:42:22.155898 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.149033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47734 (local address 127.13.88.252:46359)
0923 19:42:22.149651 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.149659 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.149684 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:42:22.149764 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.149771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.149864 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.150012 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:22.150374 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.152062 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.153610 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.154805 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.154955 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.155227 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.155449 (+ 222us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.155574 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":293,"threads_started":1}
I20260923 19:42:22.156737 20591 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260923 19:42:22.157115 20619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 134e976966a340ffa2707fe7a13ec7a0. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: NON_VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: true } } }
I20260923 19:42:22.157402 20619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: LEARNER
I20260923 19:42:22.157809 20347 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: attempting to promote NON_VOTER 2c2f3245d88c48cfb18ec735d416034e to VOTER
I20260923 19:42:22.158589 20347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } }
I20260923 19:42:22.160547 20401 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Refusing update from remote peer 134e976966a340ffa2707fe7a13ec7a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260923 19:42:22.160578 20591 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 LEARNER]: Refusing update from remote peer 134e976966a340ffa2707fe7a13ec7a0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260923 19:42:22.161127 20344 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260923 19:42:22.161428 20347 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260923 19:42:22.163264 20344 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 2c2f3245d88c48cfb18ec735d416034e (127.13.88.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.163861 20401 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 2c2f3245d88c48cfb18ec735d416034e (127.13.88.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.166390 20429 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.166658 20429 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:22.167992 20591 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 2c2f3245d88c48cfb18ec735d416034e (127.13.88.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.171785 20619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.172034 20619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:22.172644 20345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.172670 20344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.172802 20347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "134e976966a340ffa2707fe7a13ec7a0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:22.172961 20344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:22.173028 20347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:22.172930 20345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0 [sys.catalog]: This master's current role is: LEADER
W20260923 19:42:22.182772 20551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:22.183075 20551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:22.183264 20551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:22.190814 20551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:22.190927 20551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:22.191179 20551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:22.200848 20551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab
--principal=oryx/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:43217
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=33663
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:22.202127 20551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:22.203527 20551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:22.216827 20638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:22.216773 20641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:22.216769 20639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:22.217587 20551 server_base.cc:1034] running on GCE node
I20260923 19:42:22.218115 20551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:22.218958 20551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:22.220146 20551 hybrid_clock.cc:648] HybridClock initialized: now 1790192542220122 us; error 58 us; skew 500 ppm
I20260923 19:42:22.220400 20551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:22.223527 20551 init.cc:377] Logged in from keytab as oryx/127.13.88.193@KRBTEST.COM (short username oryx)
I20260923 19:42:22.224896 20551 webserver.cc:460] Webserver started at http://127.13.88.193:33663/ using document root <none> and password file <none>
I20260923 19:42:22.225473 20551 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:22.225579 20551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:22.230612 20551 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:22.233244 20648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:22.234508 20551 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:22.234678 20551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "955e450bf2014b2ab576b87b2994d231"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "9d0cb92ca603f2ef0071d6e706bb572b"
server_key_iv: "126ca4edc32f352579f27724c11083e4"
server_key_version: "encryptionkey@0"
I20260923 19:42:22.235704 20551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:22.256287 20551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:22.260740 20551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:22.261019 20551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:22.261984 20551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:22.263278 20551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:22.263377 20551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:22.263500 20551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:22.263586 20551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:22.296943 20551 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:43217
I20260923 19:42:22.297029 20760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:43217 every 8 connection(s)
I20260923 19:42:22.298434 20551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:22.304981 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 20551
I20260923 19:42:22.305387 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19982
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.253@KRBTEST.COM
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.252@KRBTEST.COM
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.194@KRBTEST.COM
I20260923 19:42:22.325979 19978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.301334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:41839 (local address 127.13.88.254:45369)
0923 19:42:22.301530 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.301538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.303038 (+ 1500us) server_negotiation.cc:407] Connection header received
0923 19:42:22.305673 (+ 2635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.305678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.305757 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.305834 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.308405 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.309532 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.312086 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.312790 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.312897 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.318646 (+ 5749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.318653 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.318658 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.318696 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.322434 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.323285 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.323292 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.323296 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.323433 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.323926 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.323933 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.323951 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.324298 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.324421 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.325426 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.325633 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:42:22.326804 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.303408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:36679 (local address 127.13.88.252:46359)
0923 19:42:22.303582 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.303589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.304476 (+ 887us) server_negotiation.cc:407] Connection header received
0923 19:42:22.305625 (+ 1149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.305631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.305708 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.305803 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.309673 (+ 3870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.310761 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.312908 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.313528 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.313618 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.319184 (+ 5566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.319193 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.319199 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.319238 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.323735 (+ 4497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.324570 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.324576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.324581 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.324734 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.325235 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.325240 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.325243 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.325583 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.325704 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.326256 (+ 552us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.326467 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 19:42:22.327163 20767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.302299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:41839)
0923 19:42:22.302936 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:22.302954 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:22.305243 (+ 2289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:22.306209 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:22.306220 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:22.307301 (+ 1081us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:22.308254 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.308272 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.309733 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.309740 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.311934 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.311948 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.313235 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.313242 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.313497 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.314292 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:22.314335 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:22.318375 (+ 4040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:22.322560 (+ 4185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.322569 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.322590 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.323143 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.323567 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.323571 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.323575 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.323791 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.324505 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:22.324511 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:22.324959 (+ 448us) client_negotiation.cc:769] Sending connection context
0923 19:42:22.326154 (+ 1195us) client_negotiation.cc:240] Negotiation successful
0923 19:42:22.326421 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":32,"spinlock_wait_cycles":12928,"thread_start_us":951,"threads_started":1}
I20260923 19:42:22.327735 20765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.301366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:52875 (local address 127.13.88.253:46727)
0923 19:42:22.301858 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.301862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.302792 (+ 930us) server_negotiation.cc:407] Connection header received
0923 19:42:22.305656 (+ 2864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.305661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.305729 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.305816 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.309673 (+ 3857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.310761 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.313272 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.313938 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.314060 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.318620 (+ 4560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.318630 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.318635 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.318676 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.322757 (+ 4081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.323568 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.323573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.323577 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.323713 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.324176 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.324181 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.324184 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.324501 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.324640 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.327146 (+ 2506us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.327373 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":254,"threads_started":1}
I20260923 19:42:22.327818 20768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.303660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.13.88.193:36679)
0923 19:42:22.304351 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:22.304368 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:22.305509 (+ 1141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:22.306206 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:22.306218 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:22.308893 (+ 2675us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:22.309507 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.309519 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.310933 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.310937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.312733 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.312747 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.313897 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.313905 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.314094 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.314695 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:22.314720 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:22.318956 (+ 4236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:22.323903 (+ 4947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.323908 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.323912 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.324411 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.324906 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.324910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.324913 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.325101 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.325782 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:22.325787 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:22.325953 (+ 166us) client_negotiation.cc:769] Sending connection context
0923 19:42:22.327053 (+ 1100us) client_negotiation.cc:240] Negotiation successful
0923 19:42:22.327365 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":172,"spinlock_wait_cycles":2688,"thread_start_us":396,"threads_started":1}
I20260923 19:42:22.328076 20766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.301904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.13.88.193:52875)
0923 19:42:22.302640 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:22.302676 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:22.305245 (+ 2569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:22.306206 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:22.306218 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:22.308893 (+ 2675us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:22.309507 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.309519 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.310920 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.310925 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.313112 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.313125 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.314309 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.314317 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.314478 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.315008 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:22.315032 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:22.318384 (+ 3352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:22.322889 (+ 4505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.322895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.322899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.323440 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.323853 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.323858 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.323862 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.324058 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.324689 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:22.324693 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:22.324952 (+ 259us) client_negotiation.cc:769] Sending connection context
0923 19:42:22.325277 (+ 325us) client_negotiation.cc:240] Negotiation successful
0923 19:42:22.325774 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"mutex_wait_us":462,"spinlock_wait_cycles":59648,"thread_start_us":474,"threads_started":1}
I20260923 19:42:22.328707 20762 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45369
I20260923 19:42:22.328953 20763 heartbeater.cc:347] Connected to a master server at 127.13.88.253:46727
I20260923 19:42:22.329051 20762 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:22.329073 20763 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:22.330042 20762 heartbeater.cc:511] Master 127.13.88.254:45369 requested a full tablet report, sending...
I20260923 19:42:22.330070 20763 heartbeater.cc:511] Master 127.13.88.253:46727 requested a full tablet report, sending...
I20260923 19:42:22.330856 20761 heartbeater.cc:347] Connected to a master server at 127.13.88.252:46359
I20260923 19:42:22.330976 20761 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:22.331370 20761 heartbeater.cc:511] Master 127.13.88.252:46359 requested a full tablet report, sending...
I20260923 19:42:22.331831 19786 ts_manager.cc:194] Re-registered known tserver with Master: 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217)
I20260923 19:42:22.332374 20391 ts_manager.cc:194] Registered new tserver with Master: 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217)
I20260923 19:42:22.332991 19786 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:41839
I20260923 19:42:22.333030 20581 ts_manager.cc:194] Registered new tserver with Master: 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217)
I20260923 19:42:22.333137 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.306521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55976 (local address 127.13.88.194:39403)
0923 19:42:22.307665 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.307674 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.308139 (+ 465us) server_negotiation.cc:407] Connection header received
0923 19:42:22.308319 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.308326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.308569 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.308701 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.310773 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.312266 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.314198 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.315049 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.315196 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.320863 (+ 5667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.320875 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.320892 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.320938 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.328851 (+ 7913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.329889 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.329897 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.329902 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.330061 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.330529 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.330533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.330538 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.330953 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.331231 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.332481 (+ 1250us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.332725 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":328,"threads_started":1}
I20260923 19:42:22.334551 20105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:22.418149 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19982
I20260923 19:42:22.434718 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:39403
--local_ip_for_outbound_sockets=127.13.88.194
--tserver_master_addrs=127.13.88.254:45369
--webserver_port=36297
--webserver_interface=127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab
--principal=oryx/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:22.755198 20772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:22.755491 20772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:22.755585 20772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:22.762504 20772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:22.762601 20772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:22.762713 20772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:22.772203 20772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab
--principal=oryx/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:39403
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=36297
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:22.773419 20772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:22.774645 20772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:22.787434 20781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:22.787477 20778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:22.787477 20779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:22.788398 20772 server_base.cc:1034] running on GCE node
I20260923 19:42:22.789067 20772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:22.790035 20772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:22.791294 20772 hybrid_clock.cc:648] HybridClock initialized: now 1790192542791240 us; error 53 us; skew 500 ppm
I20260923 19:42:22.791641 20772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:22.794852 20772 init.cc:377] Logged in from keytab as oryx/127.13.88.194@KRBTEST.COM (short username oryx)
I20260923 19:42:22.796277 20772 webserver.cc:460] Webserver started at http://127.13.88.194:36297/ using document root <none> and password file <none>
I20260923 19:42:22.796952 20772 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:22.797093 20772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:22.802521 20772 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:22.805365 20788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:22.806851 20772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:22.807041 20772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "338f3669b8e2431099b3eaf929a565b0"
format_stamp: "Formatted at 2026-09-23 19:42:19 on dist-test-slave-xg7f"
server_key: "5a8323671251b9f1a80e87f46db0a547"
server_key_iv: "2b78daa4a8892a9587dee979570c960f"
server_key_version: "encryptionkey@0"
I20260923 19:42:22.808159 20772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:22.827507 20772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:22.832273 20772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:22.832587 20772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:22.833576 20772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:22.835199 20772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:22.835342 20772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:22.835444 20772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:22.835511 20772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:22.867764 20772 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:39403
I20260923 19:42:22.867861 20900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:39403 every 8 connection(s)
I20260923 19:42:22.869206 20772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:22.873730 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 20772
I20260923 19:42:22.874094 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 20115
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.195@KRBTEST.COM
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.252@KRBTEST.COM
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.253@KRBTEST.COM
Sep 23 19:42:22 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192542, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:22.909300 20910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.875697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49480 (local address 127.13.88.195:46723)
0923 19:42:22.881503 (+ 5806us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.881512 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.881545 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:42:22.881625 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.881633 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.881945 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.882105 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.886815 (+ 4710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.889806 (+ 2991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.893360 (+ 3554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.894302 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.894423 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.900815 (+ 6392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.900830 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.900846 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.900887 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.904980 (+ 4093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.905802 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.905810 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.905814 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.905984 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.906649 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.906654 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.906665 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.907087 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.907413 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.908640 (+ 1227us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.908899 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5606,"thread_start_us":6583,"threads_started":1}
I20260923 19:42:22.910764 20238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:22.911618 20906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.872101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:57869 (local address 127.13.88.252:46359)
0923 19:42:22.892605 (+ 20504us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.892611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.892629 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:42:22.892684 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.892689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.892758 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.892862 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.894234 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.895385 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.898521 (+ 3136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.899232 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.899382 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.904056 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.904062 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.904066 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.904103 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.907623 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.908628 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.908633 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.908636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.908758 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.909262 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.909268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.909274 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.909602 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.910873 (+ 1271us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.911020 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.911251 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20376,"thread_start_us":20869,"threads_started":1}
I20260923 19:42:22.912595 20905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.872053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:40157 (local address 127.13.88.254:45369)
0923 19:42:22.892661 (+ 20608us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.892666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.892681 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:42:22.892731 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.892734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.892788 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.894209 (+ 1421us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.894379 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.895443 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.898511 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.900132 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.900250 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.905716 (+ 5466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.905725 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.905732 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.905773 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.909490 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.910305 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.910310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.910313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.910477 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.910953 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.910959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.910962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.911328 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.911490 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.911969 (+ 479us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.912126 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20513,"thread_start_us":20414,"threads_started":1}
I20260923 19:42:22.917300 20908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.872770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.13.88.194:57869)
0923 19:42:22.891292 (+ 18522us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:22.891316 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:22.891457 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:22.892918 (+ 1461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:22.892925 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:22.893624 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:22.894037 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.894060 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.895611 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.895615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.898336 (+ 2721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.898366 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.899475 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.899481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.899784 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.900462 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:22.900493 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:22.903702 (+ 3209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:22.907772 (+ 4070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.907780 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.907801 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.908481 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.908895 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.908899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.908903 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.909119 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.909754 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:22.909762 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:22.910167 (+ 405us) client_negotiation.cc:769] Sending connection context
0923 19:42:22.910472 (+ 305us) client_negotiation.cc:240] Negotiation successful
0923 19:42:22.915874 (+ 5402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18329,"mutex_wait_us":5721,"thread_start_us":2886,"threads_started":1}
I20260923 19:42:22.917851 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.872366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:36193 (local address 127.13.88.253:46727)
0923 19:42:22.884225 (+ 11859us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:22.884235 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:22.884258 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:42:22.888041 (+ 3783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:22.888051 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:22.888166 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:22.888258 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:22.894299 (+ 6041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.895427 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.898871 (+ 3444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.899539 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.899682 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.904522 (+ 4840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:22.904531 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:22.904536 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:22.904600 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:22.909723 (+ 5123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.915973 (+ 6250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.915979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.915982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.916110 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:22.916493 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:22.916498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:22.916501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:22.916778 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:22.916931 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:22.917295 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 19:42:22.917505 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11722,"thread_start_us":11628,"threads_started":1}
I20260923 19:42:22.917876 20911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.876530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.13.88.194:36193)
0923 19:42:22.882794 (+ 6264us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:22.882814 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:22.887446 (+ 4632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:22.888868 (+ 1422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:22.888886 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:22.891771 (+ 2885us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:22.894035 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.894061 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.895639 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.895644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.898354 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.898367 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.900497 (+ 2130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.900503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.900703 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.901235 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:22.901264 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:22.904148 (+ 2884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:22.909876 (+ 5728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.909880 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.909884 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.915844 (+ 5960us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.916228 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.916233 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.916236 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.916378 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.916905 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:22.916910 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:22.917047 (+ 137us) client_negotiation.cc:769] Sending connection context
0923 19:42:22.917187 (+ 140us) client_negotiation.cc:240] Negotiation successful
0923 19:42:22.917457 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6098,"mutex_wait_us":391,"thread_start_us":5937,"threads_started":1}
I20260923 19:42:22.918637 20912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:22.872770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.194:40157)
0923 19:42:22.881615 (+ 8845us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:22.881673 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:22.887357 (+ 5684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:22.892962 (+ 5605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:22.892968 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:22.893577 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:22.894035 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.894060 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.895609 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.895615 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.898353 (+ 2738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:22.898367 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:22.900788 (+ 2421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:22.900798 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:22.901005 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:22.901586 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:22.901611 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:22.905333 (+ 3722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:22.909631 (+ 4298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.909637 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.909641 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.910168 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.910611 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:22.910616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:22.910619 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:22.910813 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:22.911486 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:22.911494 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:22.911675 (+ 181us) client_negotiation.cc:769] Sending connection context
0923 19:42:22.911856 (+ 181us) client_negotiation.cc:240] Negotiation successful
0923 19:42:22.918218 (+ 6362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8478,"mutex_wait_us":6188,"thread_start_us":17876,"threads_started":1}
I20260923 19:42:22.919076 20901 heartbeater.cc:347] Connected to a master server at 127.13.88.252:46359
I20260923 19:42:22.919046 20903 heartbeater.cc:347] Connected to a master server at 127.13.88.253:46727
I20260923 19:42:22.919440 20901 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:22.919435 20903 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:22.919466 20902 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45369
I20260923 19:42:22.919651 20902 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:22.920533 20901 heartbeater.cc:511] Master 127.13.88.252:46359 requested a full tablet report, sending...
I20260923 19:42:22.920565 20902 heartbeater.cc:511] Master 127.13.88.254:45369 requested a full tablet report, sending...
I20260923 19:42:22.920593 20903 heartbeater.cc:511] Master 127.13.88.253:46727 requested a full tablet report, sending...
I20260923 19:42:22.922195 19786 ts_manager.cc:194] Re-registered known tserver with Master: 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403)
I20260923 19:42:22.922367 20391 ts_manager.cc:194] Registered new tserver with Master: 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403)
I20260923 19:42:22.922367 20581 ts_manager.cc:194] Registered new tserver with Master: 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403)
I20260923 19:42:22.923523 19786 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:40157
I20260923 19:42:22.998404 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 20115
I20260923 19:42:23.015252 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:46723
--local_ip_for_outbound_sockets=127.13.88.195
--tserver_master_addrs=127.13.88.254:45369
--webserver_port=39757
--webserver_interface=127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab
--principal=oryx/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:42535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:42:23.335867 20762 heartbeater.cc:503] Master 127.13.88.254:45369 was elected leader, sending a full tablet report...
W20260923 19:42:23.336529 20914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:23.336819 20914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:23.337013 20914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:23.344419 20914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:23.344542 20914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:23.344708 20914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:23.354568 20914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:42535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab
--principal=oryx/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:46723
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=39757
--tserver_master_addrs=127.13.88.254:45369,127.13.88.253:46727,127.13.88.252:46359
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:23.355877 20914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:23.357190 20914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:23.369834 20919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:23.369892 20922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:23.369933 20920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:23.370903 20914 server_base.cc:1034] running on GCE node
I20260923 19:42:23.371528 20914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:23.372392 20914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:23.373685 20914 hybrid_clock.cc:648] HybridClock initialized: now 1790192543373617 us; error 51 us; skew 500 ppm
I20260923 19:42:23.373977 20914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:23 dist-test-slave-xg7f krb5kdc[19742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192543, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:23.377454 20914 init.cc:377] Logged in from keytab as oryx/127.13.88.195@KRBTEST.COM (short username oryx)
I20260923 19:42:23.378911 20914 webserver.cc:460] Webserver started at http://127.13.88.195:39757/ using document root <none> and password file <none>
I20260923 19:42:23.379649 20914 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:23.379813 20914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:23.385071 20914 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260923 19:42:23.387823 20929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:23.389199 20914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:23.389374 20914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "cec80cc86c0c4e27882efa0e71b2d7b7"
format_stamp: "Formatted at 2026-09-23 19:42:20 on dist-test-slave-xg7f"
server_key: "cfaf1aefe84c01fe5f021bac46504acc"
server_key_iv: "b3e9a32a645cde28b0c4298877934875"
server_key_version: "encryptionkey@0"
I20260923 19:42:23.390292 20914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:23.404601 20914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:23.408496 20914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:23.408754 20914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:23.409610 20914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:23.410812 20914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:23.410921 20914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:23.411054 20914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:23.411177 20914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:23.444869 20914 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:46723
I20260923 19:42:23.444960 21041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:46723 every 8 connection(s)
I20260923 19:42:23.446309 20914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:23.454308 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 20914
Sep 23 19:42:23 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192543, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.252@KRBTEST.COM
Sep 23 19:42:23 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192543, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
Sep 23 19:42:23 dist-test-slave-xg7f krb5kdc[19742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192543, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.253@KRBTEST.COM
I20260923 19:42:23.500571 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.449180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:33745 (local address 127.13.88.253:46727)
0923 19:42:23.456477 (+ 7297us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.456486 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.472631 (+ 16145us) server_negotiation.cc:407] Connection header received
0923 19:42:23.473149 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.473158 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.473269 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.473363 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.479220 (+ 5857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.480323 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.485475 (+ 5152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.486135 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.486229 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.493124 (+ 6895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.493131 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.493136 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.493187 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.497221 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.498488 (+ 1267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.498494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.498500 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.498628 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.499036 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.499041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.499043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.499365 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.499518 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.499997 (+ 479us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.500206 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7146,"thread_start_us":7043,"threads_started":1}
I20260923 19:42:23.501683 21051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.449878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.13.88.195:42561)
0923 19:42:23.463189 (+ 13311us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.463259 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.467485 (+ 4226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.481657 (+ 14172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.481661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.482099 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:23.482327 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.482340 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.483809 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.483814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.485281 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.485290 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.486250 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.486256 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.486576 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.488393 (+ 1817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:23.488414 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:23.491504 (+ 3090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:23.497007 (+ 5503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:23.497017 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:23.497036 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:23.497586 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:23.498029 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:23.498034 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:23.498039 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:23.498299 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:23.498952 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:23.498963 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:23.499407 (+ 444us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.499710 (+ 303us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.500281 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12913,"mutex_wait_us":38,"spinlock_wait_cycles":17792,"thread_start_us":28313,"threads_started":1}
I20260923 19:42:23.503165 21048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.449435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:42561 (local address 127.13.88.252:46359)
0923 19:42:23.477810 (+ 28375us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.477819 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.477842 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:42:23.477931 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.477935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.478021 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.482494 (+ 4473us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.482647 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.483660 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.485415 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.486007 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.487030 (+ 1023us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.491782 (+ 4752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.491791 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.491797 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.491884 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.496831 (+ 4947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.497740 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.497745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.497749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.497888 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.498452 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.498459 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.498465 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.498802 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.502432 (+ 3630us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.502548 (+ 116us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.502764 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28226,"thread_start_us":28140,"threads_started":1}
I20260923 19:42:23.503566 21049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.449920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.13.88.195:33745)
0923 19:42:23.472505 (+ 22585us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.472528 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.472973 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.473932 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.473948 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.475032 (+ 1084us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:23.477257 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.477290 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.481349 (+ 4059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.481352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.484985 (+ 3633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.484998 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.486560 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.486566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.486743 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.487555 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:23.487582 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:23.492887 (+ 5305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:23.497840 (+ 4953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:23.497846 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:23.497849 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:23.498357 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:23.498766 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:23.498770 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:23.498774 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:23.498924 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:23.499593 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:23.499597 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:23.499731 (+ 134us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.502736 (+ 3005us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.503003 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22414,"mutex_wait_us":2,"thread_start_us":15933,"threads_started":1}
I20260923 19:42:23.504418 21042 heartbeater.cc:347] Connected to a master server at 127.13.88.252:46359
I20260923 19:42:23.504720 21044 heartbeater.cc:347] Connected to a master server at 127.13.88.253:46727
I20260923 19:42:23.504774 21042 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:23.504851 21044 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:23.505753 21044 heartbeater.cc:511] Master 127.13.88.253:46727 requested a full tablet report, sending...
I20260923 19:42:23.505779 21042 heartbeater.cc:511] Master 127.13.88.252:46359 requested a full tablet report, sending...
I20260923 19:42:23.507474 20391 ts_manager.cc:194] Registered new tserver with Master: cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:23.508420 20581 ts_manager.cc:194] Registered new tserver with Master: cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:23.514827 21050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.449878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.195:50607)
0923 19:42:23.478469 (+ 28591us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.478495 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.478604 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.479230 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.479235 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.479754 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:23.480024 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.480035 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.481277 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.481282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.487206 (+ 5924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.487218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.488634 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.488641 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.488908 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.489661 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:23.489687 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:23.492158 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:23.510894 (+ 18736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:23.510900 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:23.510905 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:23.511582 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:23.512177 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:23.512184 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:23.512189 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:23.512365 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:23.513735 (+ 1370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:23.513740 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:23.513927 (+ 187us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.514081 (+ 154us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.514376 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28434,"mutex_wait_us":1720,"thread_start_us":22618,"threads_started":1}
I20260923 19:42:23.516489 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.449224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:50607 (local address 127.13.88.254:45369)
0923 19:42:23.476182 (+ 26958us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.476191 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.478562 (+ 2371us) server_negotiation.cc:407] Connection header received
0923 19:42:23.478712 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.478721 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.478814 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.478943 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.480438 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.481118 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.487374 (+ 6256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.488034 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.488165 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.492337 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.492343 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.492349 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.492388 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.509833 (+ 17445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.511801 (+ 1968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.511807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.511810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.511975 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.512519 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.512527 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.512530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.513514 (+ 984us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.513671 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.515411 (+ 1740us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.516072 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26808,"thread_start_us":26967,"threads_started":1}
I20260923 19:42:23.517448 21043 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45369
I20260923 19:42:23.517591 21043 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:23.518059 21043 heartbeater.cc:511] Master 127.13.88.254:45369 requested a full tablet report, sending...
I20260923 19:42:23.519147 19786 ts_manager.cc:194] Re-registered known tserver with Master: cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:23.520289 19786 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:50607
I20260923 19:42:23.521581 21059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.476367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.13.88.254:45369)
0923 19:42:23.479086 (+ 2719us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.479091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.497336 (+ 18245us) server_negotiation.cc:407] Connection header received
0923 19:42:23.497393 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.497398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.497487 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.497599 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.500924 (+ 3325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.502172 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.507075 (+ 4903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.507899 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.508021 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.512457 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.512466 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.512471 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.512514 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.516006 (+ 3492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.516914 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.516919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.516923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.517051 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.519755 (+ 2704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.519760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.519764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.520077 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.520333 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.520935 (+ 602us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.521241 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2619,"thread_start_us":2742,"threads_started":1}
I20260923 19:42:23.523808 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.470124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50792 (local address 127.13.88.253:46727)
0923 19:42:23.495161 (+ 25037us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.495173 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.495908 (+ 735us) server_negotiation.cc:407] Connection header received
0923 19:42:23.496162 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.496170 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.496278 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.496384 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.501724 (+ 5340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.503925 (+ 2201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.509617 (+ 5692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.510316 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.510450 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.514584 (+ 4134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.514591 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.514596 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.514632 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.518857 (+ 4225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.519705 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.519710 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.519714 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.519856 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.520267 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.520274 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.520277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.520627 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.522143 (+ 1516us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.523183 (+ 1040us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.523416 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24875,"thread_start_us":25055,"threads_started":1}
I20260923 19:42:23.528434 21048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.488740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47744 (local address 127.13.88.252:46359)
0923 19:42:23.504526 (+ 15786us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.504533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.510673 (+ 6140us) server_negotiation.cc:407] Connection header received
0923 19:42:23.510848 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.510855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.510975 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.511074 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.513170 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.514261 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.516471 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.517140 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.517296 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.523047 (+ 5751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.523054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.523058 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.523134 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.525948 (+ 2814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.526547 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.526552 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.526555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.526683 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.527034 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.527039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.527042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.527359 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.527606 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.527917 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.528138 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15690,"thread_start_us":21205,"threads_started":1}
I20260923 19:42:23.526240 19786 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:42:23.533399 19786 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:23.589236 21074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.550633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55992 (local address 127.13.88.194:39403)
0923 19:42:23.581506 (+ 30873us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.581514 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.581539 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:42:23.581621 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.581629 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.581847 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.582066 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:23.582938 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.584546 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.586920 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.588261 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.588407 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.588619 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.588834 (+ 215us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.589005 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30701,"thread_start_us":30591,"threads_started":1}
I20260923 19:42:23.589329 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.550440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:39403 (local address 127.0.0.1:55992)
0923 19:42:23.551030 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.551055 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.551238 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.582078 (+ 30840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.582083 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.582111 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:23.582676 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.582692 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.584688 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.584693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.586777 (+ 2084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.586792 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.588455 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.588461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.588646 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.588677 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.588776 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.588901 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":24,"thread_start_us":566,"threads_started":1}
I20260923 19:42:23.590114 21075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.550782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53256)
0923 19:42:23.578180 (+ 27398us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.578195 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.578298 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.579849 (+ 1551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.579854 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.579885 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:23.580171 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.580180 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.582078 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.582083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.584542 (+ 2459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.584560 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.589339 (+ 4779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.589348 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.589525 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.589554 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.589643 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.589773 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27258,"thread_start_us":27097,"threads_started":1}
I20260923 19:42:23.590166 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.550995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53256 (local address 127.13.88.193:43217)
0923 19:42:23.578899 (+ 27904us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.578909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.578939 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:42:23.579049 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.579058 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.579395 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.579612 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:23.580341 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.581913 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.586918 (+ 5005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.589115 (+ 2197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.589254 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.589472 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.589708 (+ 236us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.589882 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27711,"thread_start_us":29324,"threads_started":1}
I20260923 19:42:23.590576 21077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.552802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:46723 (local address 127.0.0.1:49496)
0923 19:42:23.580927 (+ 28125us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.580944 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.581055 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.582236 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.582242 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.582262 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:23.582701 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.582710 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.584378 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.584388 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.586586 (+ 2198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.586600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.589718 (+ 3118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.589724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.589893 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.589924 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.590025 (+ 101us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.590141 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28000,"mutex_wait_us":3,"thread_start_us":27867,"threads_started":1}
I20260923 19:42:23.593323 20836 tablet_service.cc:1467] Processing CreateTablet for tablet 747089b3381a4c2caf630fe8e715c550 (DEFAULT_TABLE table=test-table [id=7a2372f7cc684b1f9e9c243335e40c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:23.593448 20696 tablet_service.cc:1467] Processing CreateTablet for tablet 747089b3381a4c2caf630fe8e715c550 (DEFAULT_TABLE table=test-table [id=7a2372f7cc684b1f9e9c243335e40c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:23.594689 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 747089b3381a4c2caf630fe8e715c550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:23.594717 20696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 747089b3381a4c2caf630fe8e715c550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:23.599730 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.553024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49496 (local address 127.13.88.195:46723)
0923 19:42:23.577625 (+ 24601us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.577640 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.581079 (+ 3439us) server_negotiation.cc:407] Connection header received
0923 19:42:23.581222 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.581234 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.581488 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.581644 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:23.582932 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.584225 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.586733 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.588307 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.588412 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.588619 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.599228 (+ 10609us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.599408 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24349,"thread_start_us":25347,"threads_started":1}
I20260923 19:42:23.603233 20977 tablet_service.cc:1467] Processing CreateTablet for tablet 747089b3381a4c2caf630fe8e715c550 (DEFAULT_TABLE table=test-table [id=7a2372f7cc684b1f9e9c243335e40c7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:23.604561 20977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 747089b3381a4c2caf630fe8e715c550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:23.606881 21079 tablet_bootstrap.cc:492] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Bootstrap starting.
I20260923 19:42:23.609853 21079 tablet_bootstrap.cc:654] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:23.610980 21079 log.cc:824] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:23.614182 21079 tablet_bootstrap.cc:492] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: No bootstrap required, opened a new log
I20260923 19:42:23.614441 21079 ts_tablet_manager.cc:1397] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260923 19:42:23.619078 21082 tablet_bootstrap.cc:492] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Bootstrap starting.
I20260923 19:42:23.619159 21080 tablet_bootstrap.cc:492] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Bootstrap starting.
I20260923 19:42:23.622253 21080 tablet_bootstrap.cc:654] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:23.622509 21082 tablet_bootstrap.cc:654] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:23.623365 21080 log.cc:824] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:23.623296 21079 raft_consensus.cc:348] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.623677 21082 log.cc:824] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:23.623730 21079 raft_consensus.cc:374] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:23.623836 21079 raft_consensus.cc:729] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 955e450bf2014b2ab576b87b2994d231, State: Initialized, Role: FOLLOWER
I20260923 19:42:23.624599 21079 consensus_queue.cc:260] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.626353 21079 ts_tablet_manager.cc:1428] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260923 19:42:23.626539 21080 tablet_bootstrap.cc:492] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: No bootstrap required, opened a new log
I20260923 19:42:23.626786 21082 tablet_bootstrap.cc:492] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: No bootstrap required, opened a new log
I20260923 19:42:23.626806 21080 ts_tablet_manager.cc:1397] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.004s
I20260923 19:42:23.627024 21082 ts_tablet_manager.cc:1397] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260923 19:42:23.635702 21080 raft_consensus.cc:348] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.635703 21082 raft_consensus.cc:348] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.636035 21080 raft_consensus.cc:374] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:23.636046 21082 raft_consensus.cc:374] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:23.636132 21080 raft_consensus.cc:729] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338f3669b8e2431099b3eaf929a565b0, State: Initialized, Role: FOLLOWER
I20260923 19:42:23.636147 21082 raft_consensus.cc:729] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec80cc86c0c4e27882efa0e71b2d7b7, State: Initialized, Role: FOLLOWER
I20260923 19:42:23.636628 21080 consensus_queue.cc:260] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.636716 21082 consensus_queue.cc:260] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.637714 20902 heartbeater.cc:503] Master 127.13.88.254:45369 was elected leader, sending a full tablet report...
I20260923 19:42:23.639091 21043 heartbeater.cc:503] Master 127.13.88.254:45369 was elected leader, sending a full tablet report...
I20260923 19:42:23.641006 21080 ts_tablet_manager.cc:1428] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Time spent starting tablet: real 0.014s user 0.011s sys 0.000s
I20260923 19:42:23.641047 21082 ts_tablet_manager.cc:1428] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Time spent starting tablet: real 0.014s user 0.006s sys 0.004s
W20260923 19:42:23.642863 20904 tablet.cc:2369] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:42:23.699241 21045 tablet.cc:2369] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:42:23.772258 21086 raft_consensus.cc:482] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:23.772513 21086 raft_consensus.cc:504] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.774147 21086 leader_election.cc:288] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217), cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:23.780543 21085 raft_consensus.cc:482] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:23.780931 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.774591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:37761 (local address 127.13.88.195:46723)
0923 19:42:23.774802 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.774822 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.775582 (+ 760us) server_negotiation.cc:407] Connection header received
0923 19:42:23.775716 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.775720 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.775786 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.775891 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:23.776603 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.777348 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.779149 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.779966 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.780087 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.780193 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.780542 (+ 349us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.780684 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:42:23.781036 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.774503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:46723 (local address 127.13.88.194:37761)
0923 19:42:23.775469 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.775483 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.775589 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.775922 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.775925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.775956 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:23.776452 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.776463 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.777470 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.777475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.778953 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.778965 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.780153 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.780160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.780334 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.780367 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.780482 (+ 115us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.780624 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":844,"spinlock_wait_cycles":896,"thread_start_us":702,"threads_started":1}
I20260923 19:42:23.780874 21085 raft_consensus.cc:504] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.781455 21088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.774424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.13.88.194:60899)
0923 19:42:23.775283 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.775307 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.775491 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.775909 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.775914 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.775950 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:23.776451 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.776463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.777666 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.777670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.779112 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.779159 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.780277 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.780283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.780486 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.780525 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.780910 (+ 385us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.781055 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"mutex_wait_us":2,"spinlock_wait_cycles":1792,"thread_start_us":430,"threads_started":1}
I20260923 19:42:23.781529 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.774665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:60899 (local address 127.13.88.193:43217)
0923 19:42:23.774986 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.774993 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.775432 (+ 439us) server_negotiation.cc:407] Connection header received
0923 19:42:23.775678 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.775684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.775761 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.775878 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:23.776657 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.777489 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.779278 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.780043 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.780207 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.780277 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.780677 (+ 400us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.780796 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260923 19:42:23.782019 20997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747089b3381a4c2caf630fe8e715c550" candidate_uuid: "338f3669b8e2431099b3eaf929a565b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" is_pre_election: true
I20260923 19:42:23.782521 20997 raft_consensus.cc:2454] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338f3669b8e2431099b3eaf929a565b0 in term 0.
I20260923 19:42:23.782611 20716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747089b3381a4c2caf630fe8e715c550" candidate_uuid: "338f3669b8e2431099b3eaf929a565b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "955e450bf2014b2ab576b87b2994d231" is_pre_election: true
I20260923 19:42:23.782868 21085 leader_election.cc:288] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403), cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:23.783048 20716 raft_consensus.cc:2454] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338f3669b8e2431099b3eaf929a565b0 in term 0.
I20260923 19:42:23.783245 20790 leader_election.cc:302] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338f3669b8e2431099b3eaf929a565b0, cec80cc86c0c4e27882efa0e71b2d7b7; no voters:
I20260923 19:42:23.783663 21086 raft_consensus.cc:2781] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:23.783805 21086 raft_consensus.cc:482] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:23.783915 21086 raft_consensus.cc:3037] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:23.787374 21086 raft_consensus.cc:504] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.788012 21086 leader_election.cc:288] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [CANDIDATE]: Term 1 election: Requested vote from peers 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217), cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:23.788501 20997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747089b3381a4c2caf630fe8e715c550" candidate_uuid: "338f3669b8e2431099b3eaf929a565b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7"
I20260923 19:42:23.788525 20716 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747089b3381a4c2caf630fe8e715c550" candidate_uuid: "338f3669b8e2431099b3eaf929a565b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "955e450bf2014b2ab576b87b2994d231"
I20260923 19:42:23.788702 20716 raft_consensus.cc:3037] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:23.788690 20997 raft_consensus.cc:3037] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:23.791220 21074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.783421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:47331 (local address 127.13.88.194:39403)
0923 19:42:23.783598 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.783605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.784103 (+ 498us) server_negotiation.cc:407] Connection header received
0923 19:42:23.784365 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.784373 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.784466 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.784526 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:23.785278 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.786341 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.788829 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.790048 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.790160 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.790229 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.790833 (+ 604us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.790960 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:42:23.791939 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.783033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:39403 (local address 127.13.88.193:47331)
0923 19:42:23.784005 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.784030 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.784198 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.784695 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.784699 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.784752 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:23.785086 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.785099 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.786477 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.786485 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.788645 (+ 2160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.788660 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.790462 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.790470 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.790645 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.790682 (+ 37us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.791426 (+ 744us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.791551 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"mutex_wait_us":118,"thread_start_us":665,"threads_started":1}
I20260923 19:42:23.791973 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.783707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:33957 (local address 127.13.88.195:46723)
0923 19:42:23.783876 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.783882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.784697 (+ 815us) server_negotiation.cc:407] Connection header received
0923 19:42:23.784967 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.784974 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.785048 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.785108 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:23.785714 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.786428 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.789393 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.790702 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.790831 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.790934 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.791560 (+ 626us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.791678 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 19:42:23.792057 20716 raft_consensus.cc:2454] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338f3669b8e2431099b3eaf929a565b0 in term 1.
I20260923 19:42:23.792578 20789 leader_election.cc:302] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338f3669b8e2431099b3eaf929a565b0, 955e450bf2014b2ab576b87b2994d231; no voters:
I20260923 19:42:23.792754 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.783312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:46723 (local address 127.13.88.193:33957)
0923 19:42:23.784620 (+ 1308us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:23.784637 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:23.784803 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:23.785313 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:23.785316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:23.785336 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:23.785568 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.785574 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.786553 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.786558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.789208 (+ 2650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:23.789223 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.791191 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.791197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:23.791389 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.791420 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:42:23.792182 (+ 762us) client_negotiation.cc:240] Negotiation successful
0923 19:42:23.792320 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1197,"mutex_wait_us":3,"thread_start_us":1065,"threads_started":1}
I20260923 19:42:23.792858 21086 raft_consensus.cc:2781] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:23.792815 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747089b3381a4c2caf630fe8e715c550" candidate_uuid: "955e450bf2014b2ab576b87b2994d231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338f3669b8e2431099b3eaf929a565b0" is_pre_election: true
I20260923 19:42:23.793538 21086 raft_consensus.cc:686] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 1 LEADER]: Becoming Leader. State: Replica: 338f3669b8e2431099b3eaf929a565b0, State: Running, Role: LEADER
I20260923 19:42:23.793653 20996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "747089b3381a4c2caf630fe8e715c550" candidate_uuid: "955e450bf2014b2ab576b87b2994d231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" is_pre_election: true
I20260923 19:42:23.794096 21086 consensus_queue.cc:237] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } }
I20260923 19:42:23.794617 20997 raft_consensus.cc:2454] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338f3669b8e2431099b3eaf929a565b0 in term 1.
I20260923 19:42:23.799081 20651 leader_election.cc:302] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 955e450bf2014b2ab576b87b2994d231; no voters: 338f3669b8e2431099b3eaf929a565b0, cec80cc86c0c4e27882efa0e71b2d7b7
I20260923 19:42:23.799477 21085 raft_consensus.cc:2726] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:42:23.800297 19787 catalog_manager.cc:5495] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "338f3669b8e2431099b3eaf929a565b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } health_report { overall_health: UNKNOWN } } }
W20260923 19:42:23.802460 20764 tablet.cc:2369] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:42:23.861258 21074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.856467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55994 (local address 127.13.88.194:39403)
0923 19:42:23.856645 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.856650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.856668 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:42:23.856877 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.856882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.856970 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.857092 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:23.857405 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.858157 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.859433 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.859829 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.859917 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.860319 (+ 402us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:23.860799 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:23.860902 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.860987 (+ 85us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.861045 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:42:23.869323 20997 raft_consensus.cc:1261] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Refusing update from remote peer 338f3669b8e2431099b3eaf929a565b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:23.869370 20716 raft_consensus.cc:1261] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Refusing update from remote peer 338f3669b8e2431099b3eaf929a565b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:23.870232 21092 consensus_queue.cc:1035] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:23.870606 21086 consensus_queue.cc:1035] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:23.883736 21096 mvcc.cc:205] Tried to move back new op lower bound from 7332628659678248960 to 7332628659385298944. Current Snapshot: MvccSnapshot[applied={T|T < 7332628659678248960}]
I20260923 19:42:23.904423 21098 mvcc.cc:205] Tried to move back new op lower bound from 7332628659678248960 to 7332628659385298944. Current Snapshot: MvccSnapshot[applied={T|T < 7332628659678248960}]
I20260923 19:42:23.909507 19786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:23.909801 19786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:23.924499 19786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 134e976966a340ffa2707fe7a13ec7a0: Sending DeleteTablet for 3 replicas of tablet 747089b3381a4c2caf630fe8e715c550
I20260923 19:42:23.925660 20836 tablet_service.cc:1514] Processing DeleteTablet for tablet 747089b3381a4c2caf630fe8e715c550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:23 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:55992
I20260923 19:42:23.925843 20977 tablet_service.cc:1514] Processing DeleteTablet for tablet 747089b3381a4c2caf630fe8e715c550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:23 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:49496
I20260923 19:42:23.926095 20696 tablet_service.cc:1514] Processing DeleteTablet for tablet 747089b3381a4c2caf630fe8e715c550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:23 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:53256
I20260923 19:42:23.939870 21108 tablet_replica.cc:330] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: stopping tablet replica
I20260923 19:42:23.940510 21108 raft_consensus.cc:2229] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:23.941282 21108 raft_consensus.cc:2258] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:23.942471 21106 tablet_replica.cc:330] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: stopping tablet replica
I20260923 19:42:23.944443 21108 ts_tablet_manager.cc:1905] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:23.944977 21106 raft_consensus.cc:2229] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:23.945694 21106 raft_consensus.cc:2258] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:23.948760 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 19755
I20260923 19:42:23.951452 21106 ts_tablet_manager.cc:1905] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:23.951676 19817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:23.956547 21107 tablet_replica.cc:330] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: stopping tablet replica
I20260923 19:42:23.963528 21107 raft_consensus.cc:2229] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:23.964141 21107 raft_consensus.cc:2258] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:23.966352 21107 ts_tablet_manager.cc:1905] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:23.966425 21108 ts_tablet_manager.cc:1918] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:23.966586 21108 log.cc:1196] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/747089b3381a4c2caf630fe8e715c550
I20260923 19:42:23.967195 21108 ts_tablet_manager.cc:1939] T 747089b3381a4c2caf630fe8e715c550 P 955e450bf2014b2ab576b87b2994d231: Deleting consensus metadata
I20260923 19:42:23.971211 21106 ts_tablet_manager.cc:1918] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:23.971510 21106 log.cc:1196] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/747089b3381a4c2caf630fe8e715c550
I20260923 19:42:23.974648 21107 ts_tablet_manager.cc:1918] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:23.974858 21107 log.cc:1196] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/747089b3381a4c2caf630fe8e715c550
I20260923 19:42:23.975430 21107 ts_tablet_manager.cc:1939] T 747089b3381a4c2caf630fe8e715c550 P cec80cc86c0c4e27882efa0e71b2d7b7: Deleting consensus metadata
I20260923 19:42:23.979693 21106 ts_tablet_manager.cc:1939] T 747089b3381a4c2caf630fe8e715c550 P 338f3669b8e2431099b3eaf929a565b0: Deleting consensus metadata
I20260923 19:42:23.979954 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.931332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50794 (local address 127.13.88.253:46727)
0923 19:42:23.931603 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.931613 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.946501 (+ 14888us) server_negotiation.cc:407] Connection header received
0923 19:42:23.947196 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.947205 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.947315 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.947444 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.951560 (+ 4116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.953070 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.955729 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.956461 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.956535 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.964800 (+ 8265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.964810 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.964814 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.964867 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.970084 (+ 5217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.971080 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.971091 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.971094 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.971286 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.978111 (+ 6825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.978117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.978121 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.978468 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.978678 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.979384 (+ 706us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.979626 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:42:23.997191 21048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:23.946837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47748 (local address 127.13.88.252:46359)
0923 19:42:23.947059 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:23.947068 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:23.982027 (+ 34959us) server_negotiation.cc:407] Connection header received
0923 19:42:23.982168 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:23.982173 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:23.982266 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:23.982362 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:23.984136 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.985275 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.987223 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:23.987888 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:23.987977 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:23.991549 (+ 3572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:23.991555 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:23.991560 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:23.991597 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:23.994421 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.995191 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.995196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.995200 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.995336 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:23.995704 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:23.995708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:23.995712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:23.995998 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:23.996243 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:23.996550 (+ 307us) server_negotiation.cc:299] Negotiation successful
0923 19:42:23.996760 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:42:24.129802 19772 catalog_manager.cc:4841] TS cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723): tablet 747089b3381a4c2caf630fe8e715c550 (table test-table [id=7a2372f7cc684b1f9e9c243335e40c7c]) successfully deleted
I20260923 19:42:24.129773 19771 catalog_manager.cc:4841] TS 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217): tablet 747089b3381a4c2caf630fe8e715c550 (table test-table [id=7a2372f7cc684b1f9e9c243335e40c7c]) successfully deleted
I20260923 19:42:24.130227 19773 catalog_manager.cc:4841] TS 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403): tablet 747089b3381a4c2caf630fe8e715c550 (table test-table [id=7a2372f7cc684b1f9e9c243335e40c7c]) successfully deleted
W20260923 19:42:24.131148 19771 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.88.193:43217, user_credentials={real_user=slave}} blocked reactor thread for 160749us
I20260923 19:42:24.131583 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 19755
I20260923 19:42:24.182376 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:24.157831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50810 (local address 127.13.88.253:46727)
0923 19:42:24.158024 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:24.158031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:24.166163 (+ 8132us) server_negotiation.cc:407] Connection header received
0923 19:42:24.166645 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:24.166652 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:24.166777 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:24.166864 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:24.169091 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:24.170245 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:24.172241 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:24.172821 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:24.172915 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:24.176218 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:24.176224 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:24.176229 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:24.176267 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:24.179372 (+ 3105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:24.180138 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:24.180143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:24.180147 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:24.180293 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:24.180707 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:24.180711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:24.180714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:24.181106 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:24.181356 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:24.181740 (+ 384us) server_negotiation.cc:299] Negotiation successful
0923 19:42:24.181991 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:24.188488 21048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:24.158444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47752 (local address 127.13.88.252:46359)
0923 19:42:24.158643 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:24.158650 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:24.173148 (+ 14498us) server_negotiation.cc:407] Connection header received
0923 19:42:24.174000 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:24.174006 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:24.174081 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:24.174141 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:24.176257 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:24.177357 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:24.179004 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:24.179747 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:24.179876 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:24.182907 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:24.182915 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:24.182923 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:24.182954 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:24.185882 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:24.186511 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:24.186517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:24.186520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:24.186649 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:24.187009 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:24.187015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:24.187019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:24.187381 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:24.187632 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:24.187964 (+ 332us) server_negotiation.cc:299] Negotiation successful
0923 19:42:24.188178 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:42:24.900413 21118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:24.899531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.195:46041)
0923 19:42:24.900018 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:24.900168 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":358,"threads_started":1}
W20260923 19:42:24.900835 21043 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:45369 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
I20260923 19:42:24.928928 21119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:24.928211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:42441)
0923 19:42:24.928585 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:24.928690 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":187,"threads_started":1}
W20260923 19:42:24.929394 20762 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:45369 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
I20260923 19:42:24.929787 21120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:24.929024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.194:36797)
0923 19:42:24.929545 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:24.929652 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":295,"threads_started":1}
W20260923 19:42:24.930169 20902 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:45369 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
I20260923 19:42:25.422565 21121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 134e976966a340ffa2707fe7a13ec7a0)
I20260923 19:42:25.422861 21121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } }
I20260923 19:42:25.423203 21122 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 134e976966a340ffa2707fe7a13ec7a0)
I20260923 19:42:25.423411 21122 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } }
I20260923 19:42:25.424357 21122 leader_election.cc:288] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369), 2c2f3245d88c48cfb18ec735d416034e (127.13.88.252:46359)
I20260923 19:42:25.425599 21125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.424510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34512)
0923 19:42:25.425142 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.425323 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"threads_started":1}
I20260923 19:42:25.426399 21121 leader_election.cc:288] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369), d0b1556ecf18479c8a4e4cc101f21866 (127.13.88.253:46727)
I20260923 19:42:25.427639 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.424510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34510)
0923 19:42:25.427120 (+ 2610us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.427318 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2450,"thread_start_us":2292,"threads_started":1}
W20260923 19:42:25.428340 20375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
W20260923 19:42:25.428352 20565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
I20260923 19:42:25.437225 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.425466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:46727 (local address 127.0.0.1:50820)
0923 19:42:25.428351 (+ 2885us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.428373 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:25.428522 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:25.429544 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:25.429549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:25.429585 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:25.429906 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.429921 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.432253 (+ 2332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.432261 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.434547 (+ 2286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.434564 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.436461 (+ 1897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.436467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.436645 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.436680 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 19:42:25.436748 (+ 68us) client_negotiation.cc:240] Negotiation successful
0923 19:42:25.436903 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2769,"thread_start_us":10259,"threads_started":1}
I20260923 19:42:25.438086 21128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.425741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50820 (local address 127.13.88.253:46727)
0923 19:42:25.429119 (+ 3378us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.429128 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.429152 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:42:25.429232 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.429240 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.429351 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.430341 (+ 990us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:25.430631 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.432046 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.434763 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.436262 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.437446 (+ 1184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.437539 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.437587 (+ 48us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.437706 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3239,"thread_start_us":2988,"threads_started":1}
I20260923 19:42:25.438840 20401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c2f3245d88c48cfb18ec735d416034e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d0b1556ecf18479c8a4e4cc101f21866" is_pre_election: true
I20260923 19:42:25.439248 20401 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c2f3245d88c48cfb18ec735d416034e in term 1.
I20260923 19:42:25.439960 21124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.439365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34518)
0923 19:42:25.439551 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.439695 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260923 19:42:25.439986 20567 leader_election.cc:302] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c2f3245d88c48cfb18ec735d416034e, d0b1556ecf18479c8a4e4cc101f21866; no voters:
W20260923 19:42:25.440186 20375 leader_election.cc:334] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369): Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
I20260923 19:42:25.440335 21121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260923 19:42:25.440460 21121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 134e976966a340ffa2707fe7a13ec7a0)
I20260923 19:42:25.440567 21121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:42:25.440685 21125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.424557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46359 (local address 127.0.0.1:47760)
0923 19:42:25.425995 (+ 1438us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.426018 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:25.426178 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:25.432403 (+ 6225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:25.432407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:25.432434 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:25.432727 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.432738 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.435949 (+ 3211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.435955 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.437984 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.437998 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.439903 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.439909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.440109 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.440154 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 19:42:25.440218 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 19:42:25.440379 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1314,"thread_start_us":337,"threads_started":1}
I20260923 19:42:25.440853 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.440469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34534)
0923 19:42:25.440596 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.440677 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260923 19:42:25.441083 20565 leader_election.cc:334] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369): Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
I20260923 19:42:25.441326 21126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.424845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47760 (local address 127.13.88.252:46359)
0923 19:42:25.431575 (+ 6730us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.431580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.431597 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:42:25.431646 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.431651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.431726 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.432897 (+ 1171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:25.433182 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.434392 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.438320 (+ 3928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.439677 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.440552 (+ 875us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.440664 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.440711 (+ 47us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.440984 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":6619,"thread_start_us":6608,"threads_started":1}
I20260923 19:42:25.441895 20591 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0b1556ecf18479c8a4e4cc101f21866" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2c2f3245d88c48cfb18ec735d416034e" is_pre_election: true
I20260923 19:42:25.443524 21121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } }
I20260923 19:42:25.443930 20591 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0b1556ecf18479c8a4e4cc101f21866 in current term 2: Already voted for candidate 2c2f3245d88c48cfb18ec735d416034e in this term.
I20260923 19:42:25.444224 21121 leader_election.cc:288] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [CANDIDATE]: Term 2 election: Requested vote from peers 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369), d0b1556ecf18479c8a4e4cc101f21866 (127.13.88.253:46727)
I20260923 19:42:25.444636 20401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2c2f3245d88c48cfb18ec735d416034e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d0b1556ecf18479c8a4e4cc101f21866"
I20260923 19:42:25.444855 20401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:42:25.444872 20378 leader_election.cc:302] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0b1556ecf18479c8a4e4cc101f21866; no voters: 134e976966a340ffa2707fe7a13ec7a0, 2c2f3245d88c48cfb18ec735d416034e
I20260923 19:42:25.445725 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.445398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34538)
0923 19:42:25.445536 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.445628 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260923 19:42:25.447822 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.447494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34546)
0923 19:42:25.447644 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.447716 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260923 19:42:25.447888 20401 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c2f3245d88c48cfb18ec735d416034e in term 2.
I20260923 19:42:25.448083 21122 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260923 19:42:25.448062 20565 leader_election.cc:334] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369): Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
I20260923 19:42:25.448392 20567 leader_election.cc:302] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c2f3245d88c48cfb18ec735d416034e, d0b1556ecf18479c8a4e4cc101f21866; no voters: 134e976966a340ffa2707fe7a13ec7a0
I20260923 19:42:25.448699 21121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:42:25.449143 21121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [term 2 LEADER]: Becoming Leader. State: Replica: 2c2f3245d88c48cfb18ec735d416034e, State: Running, Role: LEADER
I20260923 19:42:25.449509 21121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } }
I20260923 19:42:25.451005 21131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c2f3245d88c48cfb18ec735d416034e. Latest consensus state: current_term: 2 leader_uuid: "2c2f3245d88c48cfb18ec735d416034e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:25.451443 21131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:25.452133 21133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:25.455742 21133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:25.456499 21133 catalog_manager.cc:1259] Loaded cluster ID: 75b8dfb7ff384dec9a9e6003b2797e82
I20260923 19:42:25.456585 21133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:25.457698 21133 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:25.458487 21133 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Loaded TSK: 0
I20260923 19:42:25.459350 21133 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:42:25.465435 20581 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:42:25.472014 20581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:25.475749 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.475325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34552)
0923 19:42:25.475472 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.475593 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 19:42:25.475950 20401 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [term 2 FOLLOWER]: Refusing update from remote peer 2c2f3245d88c48cfb18ec735d416034e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260923 19:42:25.476802 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.476382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34560)
0923 19:42:25.476547 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.476649 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 19:42:25.476738 21131 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260923 19:42:25.477066 20565 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e -> Peer 134e976966a340ffa2707fe7a13ec7a0 (127.13.88.254:45369): Couldn't send request to peer 134e976966a340ffa2707fe7a13ec7a0. Status: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:42:25.478971 21122 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c2f3245d88c48cfb18ec735d416034e. Latest consensus state: current_term: 2 leader_uuid: "2c2f3245d88c48cfb18ec735d416034e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:25.479255 21122 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:25.480849 21131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2c2f3245d88c48cfb18ec735d416034e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:25.481097 21131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:25.481498 21122 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2c2f3245d88c48cfb18ec735d416034e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "134e976966a340ffa2707fe7a13ec7a0" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45369 } } peers { permanent_uuid: "d0b1556ecf18479c8a4e4cc101f21866" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 46727 } attrs { promote: false } } peers { permanent_uuid: "2c2f3245d88c48cfb18ec735d416034e" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46359 } attrs { promote: false } } }
I20260923 19:42:25.481757 21122 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0b1556ecf18479c8a4e4cc101f21866 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:42:25.497676 21123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.489266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:39403 (local address 127.0.0.1:56004)
0923 19:42:25.489485 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.489505 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:25.489635 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:25.492177 (+ 2542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:25.492181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:25.492204 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:25.492438 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.492453 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.494353 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.494358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.495860 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.495871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.496920 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.496926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.497111 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.497134 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:42:25.497231 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 19:42:25.497379 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":2}
I20260923 19:42:25.497746 21140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.489395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56004 (local address 127.13.88.194:39403)
0923 19:42:25.491848 (+ 2453us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.491856 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.491873 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:42:25.491943 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.491949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.492018 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.492606 (+ 588us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:25.492821 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.494203 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.496009 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.496738 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.496913 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.497005 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.497267 (+ 262us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.497401 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2326,"thread_start_us":2216,"threads_started":1}
I20260923 19:42:25.498131 21127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.489862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:46723 (local address 127.0.0.1:49504)
0923 19:42:25.490084 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.490105 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:25.490217 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:25.491363 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:25.491372 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:25.491407 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:25.491922 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.491940 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.493197 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.493203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.494963 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.494976 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.497129 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.497139 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.497416 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.497471 (+ 55us) client_negotiation.cc:769] Sending connection context
0923 19:42:25.497555 (+ 84us) client_negotiation.cc:240] Negotiation successful
0923 19:42:25.497734 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":1}
I20260923 19:42:25.498505 20836 tablet_service.cc:1467] Processing CreateTablet for tablet a64fda6268fe4fc392c9c8eb349f5c30 (DEFAULT_TABLE table=test-table [id=e6228e48a1df44029845dddcc847ac9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:25.499015 20836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a64fda6268fe4fc392c9c8eb349f5c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:25.499330 21141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.490318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49504 (local address 127.13.88.195:46723)
0923 19:42:25.490892 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.490902 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.490926 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:42:25.491015 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.491024 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.491164 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.492153 (+ 989us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:25.492354 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.493061 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.495163 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.496799 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.498522 (+ 1723us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.498673 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.498731 (+ 58us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.498906 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":286,"threads_started":1}
I20260923 19:42:25.499979 20977 tablet_service.cc:1467] Processing CreateTablet for tablet a64fda6268fe4fc392c9c8eb349f5c30 (DEFAULT_TABLE table=test-table [id=e6228e48a1df44029845dddcc847ac9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:25.500355 20977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a64fda6268fe4fc392c9c8eb349f5c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:25.504791 21144 tablet_bootstrap.cc:492] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: Bootstrap starting.
I20260923 19:42:25.505788 21145 tablet_bootstrap.cc:492] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: Bootstrap starting.
I20260923 19:42:25.506608 21144 tablet_bootstrap.cc:654] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:25.507476 21145 tablet_bootstrap.cc:654] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:25.510896 21145 tablet_bootstrap.cc:492] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: No bootstrap required, opened a new log
I20260923 19:42:25.510865 21144 tablet_bootstrap.cc:492] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: No bootstrap required, opened a new log
I20260923 19:42:25.511029 21144 ts_tablet_manager.cc:1397] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260923 19:42:25.511389 21145 ts_tablet_manager.cc:1397] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 19:42:25.511893 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.491538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53262)
0923 19:42:25.492169 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.492186 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:25.492293 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:25.504051 (+ 11758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:25.504059 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:25.504097 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:25.505453 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.505464 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.506916 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.506921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.509434 (+ 2513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:25.509454 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.510876 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.510882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:25.511080 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.511187 (+ 107us) client_negotiation.cc:769] Sending connection context
0923 19:42:25.511292 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:42:25.511450 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"spinlock_wait_cycles":10624,"thread_start_us":530,"threads_started":1}
I20260923 19:42:25.511952 21144 raft_consensus.cc:348] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.512233 21144 raft_consensus.cc:374] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:25.512377 21144 raft_consensus.cc:729] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338f3669b8e2431099b3eaf929a565b0, State: Initialized, Role: FOLLOWER
I20260923 19:42:25.512636 21143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.491993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53262 (local address 127.13.88.193:43217)
0923 19:42:25.503702 (+ 11709us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.503708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.503744 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:42:25.503837 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.503842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.503915 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.504011 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:25.505655 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.506719 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.509654 (+ 2935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.510670 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.510822 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.510932 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.512181 (+ 1249us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.512373 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11583,"thread_start_us":11501,"threads_started":1}
I20260923 19:42:25.512579 21145 raft_consensus.cc:348] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.512621 21144 consensus_queue.cc:260] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.512782 21145 raft_consensus.cc:374] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:25.512862 21145 raft_consensus.cc:729] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec80cc86c0c4e27882efa0e71b2d7b7, State: Initialized, Role: FOLLOWER
I20260923 19:42:25.513248 20696 tablet_service.cc:1467] Processing CreateTablet for tablet a64fda6268fe4fc392c9c8eb349f5c30 (DEFAULT_TABLE table=test-table [id=e6228e48a1df44029845dddcc847ac9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:25.513151 21145 consensus_queue.cc:260] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.513687 20696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a64fda6268fe4fc392c9c8eb349f5c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:25.514123 21145 ts_tablet_manager.cc:1428] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:25.517520 21042 heartbeater.cc:503] Master 127.13.88.252:46359 was elected leader, sending a full tablet report...
I20260923 19:42:25.521373 21151 tablet_bootstrap.cc:492] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: Bootstrap starting.
I20260923 19:42:25.522245 21150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.514791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.195:38961)
0923 19:42:25.521836 (+ 7045us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.522003 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6924,"thread_start_us":6805,"threads_started":1}
I20260923 19:42:25.523329 21144 ts_tablet_manager.cc:1428] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: Time spent starting tablet: real 0.012s user 0.003s sys 0.009s
I20260923 19:42:25.524729 20901 heartbeater.cc:503] Master 127.13.88.252:46359 was elected leader, sending a full tablet report...
I20260923 19:42:25.525264 21151 tablet_bootstrap.cc:654] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:25.525375 21150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.524950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.195:56633)
0923 19:42:25.525144 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.525234 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260923 19:42:25.526325 21152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.523542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.194:38225)
0923 19:42:25.525972 (+ 2430us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.526090 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2317,"thread_start_us":2185,"threads_started":1}
I20260923 19:42:25.527585 21152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.526900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.194:39759)
0923 19:42:25.527208 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.527294 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"threads_started":1}
I20260923 19:42:25.528069 21151 tablet_bootstrap.cc:492] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: No bootstrap required, opened a new log
I20260923 19:42:25.528214 21151 ts_tablet_manager.cc:1397] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260923 19:42:25.528944 21151 raft_consensus.cc:348] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.529155 21151 raft_consensus.cc:374] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:25.529264 21151 raft_consensus.cc:729] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 955e450bf2014b2ab576b87b2994d231, State: Initialized, Role: FOLLOWER
I20260923 19:42:25.529497 21151 consensus_queue.cc:260] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.530115 21151 ts_tablet_manager.cc:1428] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:42:25.531528 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.530424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:46707)
0923 19:42:25.531157 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.531278 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":462,"threads_started":1}
I20260923 19:42:25.531948 20761 heartbeater.cc:503] Master 127.13.88.252:46359 was elected leader, sending a full tablet report...
I20260923 19:42:25.532475 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.532124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:35209)
0923 19:42:25.532264 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.532343 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 19:42:25.659305 21155 raft_consensus.cc:482] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:25.659519 21155 raft_consensus.cc:504] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.660250 21155 leader_election.cc:288] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403), cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:25.660701 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64fda6268fe4fc392c9c8eb349f5c30" candidate_uuid: "955e450bf2014b2ab576b87b2994d231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338f3669b8e2431099b3eaf929a565b0" is_pre_election: true
I20260923 19:42:25.660774 20997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64fda6268fe4fc392c9c8eb349f5c30" candidate_uuid: "955e450bf2014b2ab576b87b2994d231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" is_pre_election: true
I20260923 19:42:25.661021 20997 raft_consensus.cc:2454] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 955e450bf2014b2ab576b87b2994d231 in term 0.
I20260923 19:42:25.661028 20856 raft_consensus.cc:2454] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 955e450bf2014b2ab576b87b2994d231 in term 0.
I20260923 19:42:25.661556 20650 leader_election.cc:302] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 955e450bf2014b2ab576b87b2994d231, cec80cc86c0c4e27882efa0e71b2d7b7; no voters:
I20260923 19:42:25.661820 21155 raft_consensus.cc:2781] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:25.661944 21155 raft_consensus.cc:482] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:25.662014 21155 raft_consensus.cc:3037] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:25.664135 21155 raft_consensus.cc:504] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.664669 21155 leader_election.cc:288] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [CANDIDATE]: Term 1 election: Requested vote from peers 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403), cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723)
I20260923 19:42:25.665241 20997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64fda6268fe4fc392c9c8eb349f5c30" candidate_uuid: "955e450bf2014b2ab576b87b2994d231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7"
I20260923 19:42:25.665222 20856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a64fda6268fe4fc392c9c8eb349f5c30" candidate_uuid: "955e450bf2014b2ab576b87b2994d231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338f3669b8e2431099b3eaf929a565b0"
I20260923 19:42:25.665427 20997 raft_consensus.cc:3037] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:25.665446 20856 raft_consensus.cc:3037] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:25.668388 20997 raft_consensus.cc:2454] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 955e450bf2014b2ab576b87b2994d231 in term 1.
I20260923 19:42:25.668381 20856 raft_consensus.cc:2454] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 955e450bf2014b2ab576b87b2994d231 in term 1.
I20260923 19:42:25.668825 20651 leader_election.cc:302] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338f3669b8e2431099b3eaf929a565b0, 955e450bf2014b2ab576b87b2994d231; no voters:
I20260923 19:42:25.669234 21155 raft_consensus.cc:2781] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:25.669734 21155 raft_consensus.cc:686] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 1 LEADER]: Becoming Leader. State: Replica: 955e450bf2014b2ab576b87b2994d231, State: Running, Role: LEADER
I20260923 19:42:25.670357 21155 consensus_queue.cc:237] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } }
I20260923 19:42:25.671335 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.670505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:46587)
0923 19:42:25.670934 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.671036 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279}
I20260923 19:42:25.674926 20580 catalog_manager.cc:5495] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 reported cstate change: term changed from 0 to 1, leader changed from <none> to 955e450bf2014b2ab576b87b2994d231 (127.13.88.193). New cstate: current_term: 1 leader_uuid: "955e450bf2014b2ab576b87b2994d231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "955e450bf2014b2ab576b87b2994d231" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43217 } health_report { overall_health: HEALTHY } } }
I20260923 19:42:25.705694 21143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.700555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.13.88.193:43217)
0923 19:42:25.700754 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.700762 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.700784 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:42:25.701028 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.701032 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.701104 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.701256 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:25.701612 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.702367 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.703714 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.704124 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.704249 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.704669 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:25.705188 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:25.705339 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.705394 (+ 55us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.705462 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:42:25.709719 20997 raft_consensus.cc:1261] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Refusing update from remote peer 955e450bf2014b2ab576b87b2994d231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:25.710009 20856 raft_consensus.cc:1261] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 1 FOLLOWER]: Refusing update from remote peer 955e450bf2014b2ab576b87b2994d231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:25.710381 21157 consensus_queue.cc:1035] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cec80cc86c0c4e27882efa0e71b2d7b7" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:25.710712 21155 consensus_queue.cc:1035] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338f3669b8e2431099b3eaf929a565b0" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:25.712858 21150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.712422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.195:37257)
0923 19:42:25.712575 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.712679 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260923 19:42:25.713555 21152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.713051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.194:51301)
0923 19:42:25.713267 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.713373 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260923 19:42:25.718860 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.718365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:34557)
0923 19:42:25.718626 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.718712 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260923 19:42:25.722038 21152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.718558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.194:50521)
0923 19:42:25.721784 (+ 3226us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.721881 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3128}
I20260923 19:42:25.734543 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.734005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.193:36131)
0923 19:42:25.734264 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.734350 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260923 19:42:25.736442 21150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.736032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.13.88.195:58247)
0923 19:42:25.736186 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.736282 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:42:25.736479 20580 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:25.736743 20580 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:25.743218 20580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c2f3245d88c48cfb18ec735d416034e: Sending DeleteTablet for 3 replicas of tablet a64fda6268fe4fc392c9c8eb349f5c30
I20260923 19:42:25.744398 20696 tablet_service.cc:1514] Processing DeleteTablet for tablet a64fda6268fe4fc392c9c8eb349f5c30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:25 UTC) from {username='oryx', principal='oryx/127.13.88.252@KRBTEST.COM'} at 127.0.0.1:53262
I20260923 19:42:25.744642 20977 tablet_service.cc:1514] Processing DeleteTablet for tablet a64fda6268fe4fc392c9c8eb349f5c30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:25 UTC) from {username='oryx', principal='oryx/127.13.88.252@KRBTEST.COM'} at 127.0.0.1:49504
I20260923 19:42:25.744735 20976 tablet_service.cc:1514] Processing DeleteTablet for tablet a64fda6268fe4fc392c9c8eb349f5c30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:25 UTC) from {username='oryx', principal='oryx/127.13.88.252@KRBTEST.COM'} at 127.0.0.1:49504
I20260923 19:42:25.745072 20836 tablet_service.cc:1514] Processing DeleteTablet for tablet a64fda6268fe4fc392c9c8eb349f5c30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:25 UTC) from {username='oryx', principal='oryx/127.13.88.252@KRBTEST.COM'} at 127.0.0.1:56004
I20260923 19:42:25.747221 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 20551
I20260923 19:42:25.758348 21171 tablet_replica.cc:330] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: stopping tablet replica
I20260923 19:42:25.759336 21171 raft_consensus.cc:2229] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:25.760138 21171 raft_consensus.cc:2258] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:25.762295 21171 ts_tablet_manager.cc:1905] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:25.763397 21170 tablet_replica.cc:330] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: stopping tablet replica
I20260923 19:42:25.763584 21170 raft_consensus.cc:2229] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:25.763904 21170 raft_consensus.cc:2258] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:25.770365 21171 ts_tablet_manager.cc:1918] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:25.770555 21171 log.cc:1196] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/a64fda6268fe4fc392c9c8eb349f5c30
I20260923 19:42:25.771133 21171 ts_tablet_manager.cc:1939] T a64fda6268fe4fc392c9c8eb349f5c30 P 338f3669b8e2431099b3eaf929a565b0: Deleting consensus metadata
I20260923 19:42:25.772275 21170 ts_tablet_manager.cc:1905] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:25.772516 20567 catalog_manager.cc:4841] TS 338f3669b8e2431099b3eaf929a565b0 (127.13.88.194:39403): tablet a64fda6268fe4fc392c9c8eb349f5c30 (table test-table [id=e6228e48a1df44029845dddcc847ac9b]) successfully deleted
I20260923 19:42:25.773998 21169 tablet_replica.cc:330] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: stopping tablet replica
I20260923 19:42:25.774189 21169 raft_consensus.cc:2229] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:25.774766 21169 raft_consensus.cc:2258] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:25.775904 21169 ts_tablet_manager.cc:1905] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:25.778566 21170 ts_tablet_manager.cc:1918] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:25.778690 21170 log.cc:1196] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/a64fda6268fe4fc392c9c8eb349f5c30
I20260923 19:42:25.779139 21170 ts_tablet_manager.cc:1939] T a64fda6268fe4fc392c9c8eb349f5c30 P cec80cc86c0c4e27882efa0e71b2d7b7: Deleting consensus metadata
I20260923 19:42:25.780264 20566 catalog_manager.cc:4841] TS cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723): tablet a64fda6268fe4fc392c9c8eb349f5c30 (table test-table [id=e6228e48a1df44029845dddcc847ac9b]) successfully deleted
W20260923 19:42:25.781224 20566 catalog_manager.cc:4808] TS cec80cc86c0c4e27882efa0e71b2d7b7 (127.13.88.195:46723): delete failed for tablet a64fda6268fe4fc392c9c8eb349f5c30 because the tablet was not found. No further retry: Not found: Tablet not found: a64fda6268fe4fc392c9c8eb349f5c30
I20260923 19:42:25.782011 21143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.748166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53284 (local address 127.13.88.193:43217)
0923 19:42:25.748318 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.748323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.762446 (+ 14123us) server_negotiation.cc:407] Connection header received
0923 19:42:25.764213 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.764220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.764319 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.764398 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:25.766280 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.767620 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.769456 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.770096 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.770216 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.773657 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:25.773677 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:25.773703 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:25.773751 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:25.777858 (+ 4107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:25.778513 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:25.778522 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:25.778526 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:25.778811 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:25.779339 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:25.779344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:25.779348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:25.779755 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:25.780067 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.781268 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.781602 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 19:42:25.782778 20756 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:25.890692 21169 ts_tablet_manager.cc:1918] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:25.890940 21169 log.cc:1196] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/a64fda6268fe4fc392c9c8eb349f5c30
I20260923 19:42:25.891546 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 20551
I20260923 19:42:25.891654 21169 ts_tablet_manager.cc:1939] T a64fda6268fe4fc392c9c8eb349f5c30 P 955e450bf2014b2ab576b87b2994d231: Deleting consensus metadata
I20260923 19:42:25.908721 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.908180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34562)
0923 19:42:25.908414 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.908529 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 19:42:25.909873 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.909417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45369 (local address 127.0.0.1:34576)
0923 19:42:25.909600 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.909698 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 19:42:25.910390 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 20772
I20260923 19:42:25.910719 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.910328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53300)
0923 19:42:25.910526 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.910606 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260923 19:42:25.910949 20565 catalog_manager.cc:4584] TS 955e450bf2014b2ab576b87b2994d231 (127.13.88.193:43217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a64fda6268fe4fc392c9c8eb349f5c30: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
I20260923 19:42:25.923053 21140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.911119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56012 (local address 127.13.88.194:39403)
0923 19:42:25.911317 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:25.911322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:25.911430 (+ 108us) server_negotiation.cc:407] Connection header received
0923 19:42:25.911569 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:25.911574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:25.911649 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:25.911743 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:25.913177 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.913877 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.915007 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:25.915473 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:25.915564 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:25.917926 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:25.917941 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:25.917957 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:25.917985 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:25.920597 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:25.921279 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:25.921286 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:25.921288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:25.921399 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:25.921702 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:25.921705 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:25.921707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:25.922047 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:25.922285 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:25.922625 (+ 340us) server_negotiation.cc:299] Negotiation successful
0923 19:42:25.922783 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:42:25.923938 20896 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:25.971529 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.971024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53312)
0923 19:42:25.971281 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.971384 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260923 19:42:25.975783 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:25.975434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53326)
0923 19:42:25.975617 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:25.975679 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260923 19:42:26.044554 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:26.044078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53330)
0923 19:42:26.044286 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:26.044414 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260923 19:42:26.045490 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:26.045179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53344)
0923 19:42:26.045318 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:26.045394 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260923 19:42:26.055764 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 20772
I20260923 19:42:26.076910 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 20914
I20260923 19:42:26.090054 21175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:26.077604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49510 (local address 127.13.88.195:46723)
0923 19:42:26.078065 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:26.078082 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:26.078096 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:42:26.078145 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:26.078149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:26.078202 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:26.078327 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:26.079654 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:26.080342 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:26.081539 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:26.081948 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:26.082072 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:26.084789 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:26.084805 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:26.084821 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:26.084851 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:26.087462 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:26.088088 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:26.088095 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:26.088098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:26.088208 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:26.088587 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:26.088592 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:26.088595 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:26.088940 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:26.089233 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:26.089505 (+ 272us) server_negotiation.cc:299] Negotiation successful
0923 19:42:26.089731 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":227,"threads_started":1}
I20260923 19:42:26.090737 21037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:26.147080 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:26.146517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53350)
0923 19:42:26.146755 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:26.146874 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260923 19:42:26.148124 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:26.147732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53352)
0923 19:42:26.147920 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:26.148000 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 19:42:26.184243 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 20914
I20260923 19:42:26.200845 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 20248
I20260923 19:42:26.201900 20421 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:26.317288 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 20248
I20260923 19:42:26.319954 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:26.319541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53360)
0923 19:42:26.319728 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:26.319813 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260923 19:42:26.320910 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:26.320603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43217 (local address 127.0.0.1:53362)
0923 19:42:26.320741 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:26.320812 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260923 19:42:26.337620 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 20346
I20260923 19:42:26.338570 20611 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:26.459717 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 20346
2026-09-23T19:42:26Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (9317 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:42:26 dist-test-slave-xg7f krb5kdc[21181](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:42:26 dist-test-slave-xg7f krb5kdc[21181](info): set up 2 sockets
Sep 23 19:42:26 dist-test-slave-xg7f krb5kdc[21181](info): commencing operation
krb5kdc: starting...
W20260923 19:42:27.552212 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.001s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:42:27 dist-test-slave-xg7f krb5kdc[21181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:42:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:27Z Disabled control of system clock
WARNING: no policy specified for oryx/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab.
Entry for principal oryx/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab.
I20260923 19:42:27.751240 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:41869
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab
--principal=oryx/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:41869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:28.061491 21194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:28.061774 21194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:28.061869 21194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:28.069164 21194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:28.069264 21194 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 19:42:28.069307 21194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:28.069360 21194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:28.069451 21194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:28.069550 21194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:28.079542 21194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:41869
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.254.keytab
--principal=oryx/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:41869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:28.080834 21194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:28.082173 21194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:28.093752 21199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:28.093787 21202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:28.093813 21200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:28.099990 21194 server_base.cc:1034] running on GCE node
I20260923 19:42:28.100733 21194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:28.102120 21194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:28.103354 21194 hybrid_clock.cc:648] HybridClock initialized: now 1790192548103291 us; error 39 us; skew 500 ppm
I20260923 19:42:28.103698 21194 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:28 dist-test-slave-xg7f krb5kdc[21181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192548, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:28.106623 21194 init.cc:377] Logged in from keytab as oryx/127.13.88.254@KRBTEST.COM (short username oryx)
I20260923 19:42:28.108088 21194 webserver.cc:460] Webserver started at http://127.13.88.254:40841/ using document root <none> and password file <none>
I20260923 19:42:28.108734 21194 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:28.108825 21194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:28.109086 21194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:28.112072 21194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "feb4a16a797442a89dc56bb92c36094e"
format_stamp: "Formatted at 2026-09-23 19:42:28 on dist-test-slave-xg7f"
server_key: "901ca4fa5a337e5a2949fa20e472d68c"
server_key_iv: "70c0daa67f7ca560f1c297621212d679"
server_key_version: "encryptionkey@0"
I20260923 19:42:28.112788 21194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "feb4a16a797442a89dc56bb92c36094e"
format_stamp: "Formatted at 2026-09-23 19:42:28 on dist-test-slave-xg7f"
server_key: "901ca4fa5a337e5a2949fa20e472d68c"
server_key_iv: "70c0daa67f7ca560f1c297621212d679"
server_key_version: "encryptionkey@0"
I20260923 19:42:28.118835 21194 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260923 19:42:28.122160 21209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:28.123458 21194 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260923 19:42:28.123634 21194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "feb4a16a797442a89dc56bb92c36094e"
format_stamp: "Formatted at 2026-09-23 19:42:28 on dist-test-slave-xg7f"
server_key: "901ca4fa5a337e5a2949fa20e472d68c"
server_key_iv: "70c0daa67f7ca560f1c297621212d679"
server_key_version: "encryptionkey@0"
I20260923 19:42:28.123842 21194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:28.140637 21194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:28.144362 21194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:28.144644 21194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:28.165706 21194 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:41869
I20260923 19:42:28.165728 21270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:41869 every 8 connection(s)
I20260923 19:42:28.167085 21194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:28.170732 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 21194
I20260923 19:42:28.170950 21271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:28.170953 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:28.171813 13667 external_mini_cluster.cc:1428] Setting key ba368ed0701954700363d00ace58fca6
I20260923 19:42:28.183075 21271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Bootstrap starting.
Sep 23 19:42:28 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:28.186313 21271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:28.187547 21271 log.cc:824] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:28.190137 21271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: No bootstrap required, opened a new log
I20260923 19:42:28.192848 21274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:28.173859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47858 (local address 127.13.88.254:41869)
0923 19:42:28.174608 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:28.174621 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:28.174660 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:42:28.176250 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:28.176276 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:28.176642 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:28.177035 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:28.178451 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.179714 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.180919 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.181668 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.181856 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:28.185871 (+ 4015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:28.185878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:28.185891 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:28.185940 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:28.189004 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:28.189652 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:28.189658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:28.189664 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:28.189824 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:28.190203 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:28.190210 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:28.190213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:28.190754 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:28.191047 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:28.191485 (+ 438us) server_negotiation.cc:299] Negotiation successful
0923 19:42:28.191905 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":354,"threads_started":1}
I20260923 19:42:28.198165 21271 raft_consensus.cc:348] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "feb4a16a797442a89dc56bb92c36094e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41869 } }
I20260923 19:42:28.198514 21271 raft_consensus.cc:374] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:28.198621 21271 raft_consensus.cc:729] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feb4a16a797442a89dc56bb92c36094e, State: Initialized, Role: FOLLOWER
I20260923 19:42:28.199276 21271 consensus_queue.cc:260] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "feb4a16a797442a89dc56bb92c36094e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41869 } }
I20260923 19:42:28.199548 21271 raft_consensus.cc:388] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:28.199687 21271 raft_consensus.cc:482] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:28.199854 21271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:28.201843 21271 raft_consensus.cc:504] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "feb4a16a797442a89dc56bb92c36094e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41869 } }
I20260923 19:42:28.202309 21271 leader_election.cc:302] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: feb4a16a797442a89dc56bb92c36094e; no voters:
I20260923 19:42:28.202917 21271 leader_election.cc:288] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:28.203061 21276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:28.203765 21276 raft_consensus.cc:686] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [term 1 LEADER]: Becoming Leader. State: Replica: feb4a16a797442a89dc56bb92c36094e, State: Running, Role: LEADER
I20260923 19:42:28.204334 21276 consensus_queue.cc:237] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "feb4a16a797442a89dc56bb92c36094e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41869 } }
I20260923 19:42:28.204882 21271 sys_catalog.cc:564] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:28.206991 21278 sys_catalog.cc:455] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [sys.catalog]: SysCatalogTable state changed. Reason: New leader feb4a16a797442a89dc56bb92c36094e. Latest consensus state: current_term: 1 leader_uuid: "feb4a16a797442a89dc56bb92c36094e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "feb4a16a797442a89dc56bb92c36094e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41869 } } }
I20260923 19:42:28.207396 21278 sys_catalog.cc:458] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:28.208170 21277 sys_catalog.cc:455] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "feb4a16a797442a89dc56bb92c36094e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "feb4a16a797442a89dc56bb92c36094e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41869 } } }
I20260923 19:42:28.208580 21277 sys_catalog.cc:458] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:28.209069 21281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:28.213796 21281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:28.222555 21281 catalog_manager.cc:1347] Generated new cluster ID: 99e3ac2be4e04778bda31c447c33c94e
I20260923 19:42:28.222657 21281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:28.232538 21281 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:28.233681 21281 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:28.240628 21281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Generated new TSK 0
I20260923 19:42:28.241362 21281 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab.
Entry for principal oryx/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab.
I20260923 19:42:28.293853 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41869
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab
--principal=oryx/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:28.617625 21297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:28.618047 21297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:28.618227 21297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:28.625429 21297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:28.625522 21297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:28.625597 21297 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:42:28.625705 21297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:28.635636 21297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab
--principal=oryx/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:41869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:28.636950 21297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:28.638281 21297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:28.651855 21302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:28.651815 21303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:28.651858 21305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:28.652767 21297 server_base.cc:1034] running on GCE node
I20260923 19:42:28.653299 21297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:28.654141 21297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:28.655373 21297 hybrid_clock.cc:648] HybridClock initialized: now 1790192548655320 us; error 38 us; skew 500 ppm
I20260923 19:42:28.655654 21297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:28 dist-test-slave-xg7f krb5kdc[21181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192548, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:28.658728 21297 init.cc:377] Logged in from keytab as oryx/127.13.88.193@KRBTEST.COM (short username oryx)
I20260923 19:42:28.660208 21297 webserver.cc:460] Webserver started at http://127.13.88.193:35579/ using document root <none> and password file <none>
I20260923 19:42:28.660889 21297 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:28.661011 21297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:28.661327 21297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:28.664253 21297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "1d96c23276914ea3a8a51e7c0fc58f97"
format_stamp: "Formatted at 2026-09-23 19:42:28 on dist-test-slave-xg7f"
server_key: "42ed6f99b8c45e34b1b7d0323c4831d4"
server_key_iv: "4fabcc052c70e058c9e470c45bb00805"
server_key_version: "encryptionkey@0"
I20260923 19:42:28.665035 21297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "1d96c23276914ea3a8a51e7c0fc58f97"
format_stamp: "Formatted at 2026-09-23 19:42:28 on dist-test-slave-xg7f"
server_key: "42ed6f99b8c45e34b1b7d0323c4831d4"
server_key_iv: "4fabcc052c70e058c9e470c45bb00805"
server_key_version: "encryptionkey@0"
I20260923 19:42:28.669972 21297 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260923 19:42:28.673224 21312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:28.674393 21297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 19:42:28.674552 21297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "1d96c23276914ea3a8a51e7c0fc58f97"
format_stamp: "Formatted at 2026-09-23 19:42:28 on dist-test-slave-xg7f"
server_key: "42ed6f99b8c45e34b1b7d0323c4831d4"
server_key_iv: "4fabcc052c70e058c9e470c45bb00805"
server_key_version: "encryptionkey@0"
I20260923 19:42:28.674760 21297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:28.700896 21297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:28.704902 21297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:28.705171 21297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:28.707989 21297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:28.708112 21297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:28.708294 21297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:28.708427 21297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:42:28 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192548, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:28.730334 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:28.708394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:35037 (local address 127.13.88.254:41869)
0923 19:42:28.708823 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:28.708830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:28.710145 (+ 1315us) server_negotiation.cc:407] Connection header received
0923 19:42:28.712192 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:28.712202 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:28.712312 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:28.712434 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:28.714429 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.715501 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.717173 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.717576 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.717703 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:28.723022 (+ 5319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:28.723027 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:28.723032 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:28.723075 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:28.726426 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:28.727410 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:28.727418 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:28.727424 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:28.727604 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:28.728154 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:28.728159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:28.728162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:28.728537 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:28.728720 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:28.729749 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0923 19:42:28.729967 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":207,"threads_started":1}
I20260923 19:42:28.731906 21322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:28.709066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41869 (local address 127.13.88.193:35037)
0923 19:42:28.709978 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:28.710027 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:28.711919 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:28.712648 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:28.712656 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:28.713252 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:28.714172 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:28.714203 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.715733 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.715738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:28.716991 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:28.717002 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.717810 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.717818 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:28.718145 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:28.718859 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:28.718895 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:28.722743 (+ 3848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:28.726584 (+ 3841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:28.726596 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:28.726617 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:28.727274 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:28.727738 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:28.727744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:28.727751 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:28.728028 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:28.728806 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:28.728819 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:28.729321 (+ 502us) client_negotiation.cc:769] Sending connection context
0923 19:42:28.729657 (+ 336us) client_negotiation.cc:240] Negotiation successful
0923 19:42:28.730212 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":386,"threads_started":1}
I20260923 19:42:28.756608 21297 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:44263
I20260923 19:42:28.756678 21432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:44263 every 8 connection(s)
I20260923 19:42:28.758317 21297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:28.758952 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:28.743124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41869 (local address 127.13.88.193:34217)
0923 19:42:28.743981 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:28.743998 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:28.744138 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:28.744664 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:28.744671 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:28.745372 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:28.745834 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:28.745850 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.747433 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.747438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:28.749030 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:28.749049 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.750239 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.750247 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:28.750496 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:28.751312 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:28.751337 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:28.752070 (+ 733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:28.756239 (+ 4169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:28.756245 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:28.756248 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:28.756944 (+ 696us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:28.757334 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:28.757337 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:28.757339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:28.757452 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:28.758025 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:28.758029 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:28.758171 (+ 142us) client_negotiation.cc:769] Sending connection context
0923 19:42:28.758276 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:42:28.758576 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":610,"threads_started":1}
I20260923 19:42:28.759337 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:28.743023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:34217 (local address 127.13.88.254:41869)
0923 19:42:28.743233 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:28.743241 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:28.744080 (+ 839us) server_negotiation.cc:407] Connection header received
0923 19:42:28.744263 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:28.744270 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:28.744363 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:28.744453 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:28.746053 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.747283 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.749213 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:28.750013 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:28.750175 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:28.752283 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:28.752290 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:28.752294 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:28.752343 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:28.756077 (+ 3734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:28.757058 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:28.757063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:28.757066 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:28.757225 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:28.757557 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:28.757562 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:28.757565 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:28.757918 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:28.758060 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:28.758445 (+ 385us) server_negotiation.cc:299] Negotiation successful
0923 19:42:28.758681 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:42:28.761776 21433 heartbeater.cc:347] Connected to a master server at 127.13.88.254:41869
I20260923 19:42:28.762017 21433 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:28.762645 21433 heartbeater.cc:511] Master 127.13.88.254:41869 requested a full tablet report, sending...
I20260923 19:42:28.764127 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 21297
I20260923 19:42:28.764348 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:28.764858 21225 ts_manager.cc:194] Registered new tserver with Master: 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263)
I20260923 19:42:28.765125 13667 external_mini_cluster.cc:1428] Setting key 68c745b392ee741e9b9dfa1816621bfe
I20260923 19:42:28.766618 21225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:35037
WARNING: no policy specified for oryx/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab.
Entry for principal oryx/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab.
I20260923 19:42:28.808502 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41869
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab
--principal=oryx/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:29.143961 21437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:29.144232 21437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:29.144410 21437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:29.151463 21437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:29.151563 21437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:29.151760 21437 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:42:29.151907 21437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:29.161711 21437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab
--principal=oryx/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:41869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:29.163044 21437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:29.164453 21437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:29.177842 21443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:29.177964 21445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:29.179128 21437 server_base.cc:1034] running on GCE node
W20260923 19:42:29.178367 21442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:29.179898 21437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:29.180822 21437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:29.182070 21437 hybrid_clock.cc:648] HybridClock initialized: now 1790192549182001 us; error 46 us; skew 500 ppm
I20260923 19:42:29.182376 21437 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:29 dist-test-slave-xg7f krb5kdc[21181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192549, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:29.185479 21437 init.cc:377] Logged in from keytab as oryx/127.13.88.194@KRBTEST.COM (short username oryx)
I20260923 19:42:29.186903 21437 webserver.cc:460] Webserver started at http://127.13.88.194:46557/ using document root <none> and password file <none>
I20260923 19:42:29.187644 21437 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:29.187757 21437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:29.188091 21437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:29.190851 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "a2991ce6662a4a2db069ecea6aa39162"
format_stamp: "Formatted at 2026-09-23 19:42:29 on dist-test-slave-xg7f"
server_key: "1e1c0b816789960b21ce37c61d990cba"
server_key_iv: "35e226a603a958d569567ff508708330"
server_key_version: "encryptionkey@0"
I20260923 19:42:29.191645 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "a2991ce6662a4a2db069ecea6aa39162"
format_stamp: "Formatted at 2026-09-23 19:42:29 on dist-test-slave-xg7f"
server_key: "1e1c0b816789960b21ce37c61d990cba"
server_key_iv: "35e226a603a958d569567ff508708330"
server_key_version: "encryptionkey@0"
I20260923 19:42:29.196671 21437 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:42:29.199991 21452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:29.201202 21437 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:29.201373 21437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "a2991ce6662a4a2db069ecea6aa39162"
format_stamp: "Formatted at 2026-09-23 19:42:29 on dist-test-slave-xg7f"
server_key: "1e1c0b816789960b21ce37c61d990cba"
server_key_iv: "35e226a603a958d569567ff508708330"
server_key_version: "encryptionkey@0"
I20260923 19:42:29.201578 21437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:29.220429 21437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:29.224479 21437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:29.224769 21437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:29.227557 21437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:29.227674 21437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:29.227836 21437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:29.227948 21437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Sep 23 19:42:29 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192549, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:29.251070 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.228087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:43385 (local address 127.13.88.254:41869)
0923 19:42:29.228304 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:29.228311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:29.229839 (+ 1528us) server_negotiation.cc:407] Connection header received
0923 19:42:29.232368 (+ 2529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:29.232375 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:29.232491 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:29.232566 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:29.235175 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.236378 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.238493 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.239272 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.239423 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.243111 (+ 3688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:29.243144 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:29.243151 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:29.243206 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:29.246888 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.247954 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.247962 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.247967 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.248133 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.248664 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.248670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.248676 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.249086 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:29.249245 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:29.250429 (+ 1184us) server_negotiation.cc:299] Negotiation successful
0923 19:42:29.250682 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:42:29.253130 21461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.228773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41869 (local address 127.13.88.194:43385)
0923 19:42:29.229639 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:29.229696 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:29.231957 (+ 2261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:29.233199 (+ 1242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:29.233212 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:29.234045 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:29.234942 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.234974 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.236534 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.236542 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.238321 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.238341 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.239564 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.239573 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.239854 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.240698 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:29.240732 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:29.242861 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:29.247049 (+ 4188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.247062 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.247074 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.247731 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.248255 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.248260 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.248265 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.248528 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.249346 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:29.249358 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:29.249927 (+ 569us) client_negotiation.cc:769] Sending connection context
0923 19:42:29.250327 (+ 400us) client_negotiation.cc:240] Negotiation successful
0923 19:42:29.251004 (+ 677us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":376,"threads_started":1}
I20260923 19:42:29.274513 21437 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:46817
I20260923 19:42:29.274485 21571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:46817 every 8 connection(s)
I20260923 19:42:29.275506 21528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.258848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41869 (local address 127.13.88.194:53497)
0923 19:42:29.259563 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:29.259579 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:29.259738 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:29.260170 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:29.260180 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:29.261033 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:29.261512 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.261532 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.262860 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.262866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.264867 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.264885 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.266027 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.266031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.266140 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.266817 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:29.266846 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:29.268130 (+ 1284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:29.272469 (+ 4339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.272473 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.272477 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.273006 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.273520 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.273530 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.273537 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.273733 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.274539 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:29.274546 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:29.274763 (+ 217us) client_negotiation.cc:769] Sending connection context
0923 19:42:29.274874 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 19:42:29.275188 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":403,"threads_started":1}
I20260923 19:42:29.275576 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.258758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:53497 (local address 127.13.88.254:41869)
0923 19:42:29.258935 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:29.258939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:29.259662 (+ 723us) server_negotiation.cc:407] Connection header received
0923 19:42:29.259887 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:29.259893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:29.260000 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:29.260111 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:29.261700 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.262713 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.265065 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.265726 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.265802 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.268355 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:29.268361 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:29.268366 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:29.268404 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:29.272261 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.273175 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.273180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.273183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.273386 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.273909 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.273916 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.273922 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.274402 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:29.274555 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:29.275024 (+ 469us) server_negotiation.cc:299] Negotiation successful
0923 19:42:29.275272 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:29.276134 21437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:29.278591 21572 heartbeater.cc:347] Connected to a master server at 127.13.88.254:41869
I20260923 19:42:29.278841 21572 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:29.279609 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 21437
I20260923 19:42:29.279714 21572 heartbeater.cc:511] Master 127.13.88.254:41869 requested a full tablet report, sending...
I20260923 19:42:29.279822 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:29.280380 13667 external_mini_cluster.cc:1428] Setting key 343621ab4da3bc210be41dec37b32690
I20260923 19:42:29.281206 21225 ts_manager.cc:194] Registered new tserver with Master: a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817)
I20260923 19:42:29.282178 21225 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:43385
WARNING: no policy specified for oryx/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab.
Entry for principal oryx/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab.
I20260923 19:42:29.325533 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41869
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab
--principal=oryx/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:29.642119 21576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:29.642379 21576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:29.642467 21576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:29.649416 21576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:29.649523 21576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:29.649607 21576 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 19:42:29.649688 21576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:29.659391 21576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab
--principal=oryx/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.13.88.254:41869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:29.660529 21576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:29.661690 21576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:29.677201 21582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:29.677147 21584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:29.677947 21581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:29.678057 21576 server_base.cc:1034] running on GCE node
I20260923 19:42:29.678812 21576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:29.679750 21576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:29.680984 21576 hybrid_clock.cc:648] HybridClock initialized: now 1790192549680921 us; error 40 us; skew 500 ppm
I20260923 19:42:29.681270 21576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:29 dist-test-slave-xg7f krb5kdc[21181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192549, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:29.684243 21576 init.cc:377] Logged in from keytab as oryx/127.13.88.195@KRBTEST.COM (short username oryx)
I20260923 19:42:29.685750 21576 webserver.cc:460] Webserver started at http://127.13.88.195:41785/ using document root <none> and password file <none>
I20260923 19:42:29.686419 21576 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:29.686542 21576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:29.686857 21576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:29.689865 21576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "a40dd9963ceb46d4bc83174e7f5d9357"
format_stamp: "Formatted at 2026-09-23 19:42:29 on dist-test-slave-xg7f"
server_key: "d6366ddc465a2463afe5e01a010b7ba1"
server_key_iv: "8b97d7e49d932294b5b567e563157242"
server_key_version: "encryptionkey@0"
I20260923 19:42:29.690645 21576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "a40dd9963ceb46d4bc83174e7f5d9357"
format_stamp: "Formatted at 2026-09-23 19:42:29 on dist-test-slave-xg7f"
server_key: "d6366ddc465a2463afe5e01a010b7ba1"
server_key_iv: "8b97d7e49d932294b5b567e563157242"
server_key_version: "encryptionkey@0"
I20260923 19:42:29.695703 21576 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:42:29.698979 21591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:29.700431 21576 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:29.700606 21576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "a40dd9963ceb46d4bc83174e7f5d9357"
format_stamp: "Formatted at 2026-09-23 19:42:29 on dist-test-slave-xg7f"
server_key: "d6366ddc465a2463afe5e01a010b7ba1"
server_key_iv: "8b97d7e49d932294b5b567e563157242"
server_key_version: "encryptionkey@0"
I20260923 19:42:29.700841 21576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:29.721318 21576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:29.725692 21576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:29.725951 21576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:29.728586 21576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:29.728695 21576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:29.728845 21576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:29.728917 21576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:42:29 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192549, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:29.753157 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.729589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:58107 (local address 127.13.88.254:41869)
0923 19:42:29.729758 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:29.729762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:29.731148 (+ 1386us) server_negotiation.cc:407] Connection header received
0923 19:42:29.733556 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:29.733562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:29.733652 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:29.733763 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:29.736124 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.736965 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.738702 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.739355 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.739485 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.744532 (+ 5047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:29.744539 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:29.744544 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:29.744588 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:29.748531 (+ 3943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.749707 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.749714 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.749719 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.749896 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.750505 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.750513 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.750518 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.750933 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:29.751130 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:29.752390 (+ 1260us) server_negotiation.cc:299] Negotiation successful
0923 19:42:29.752685 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:42:29.754981 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.730153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41869 (local address 127.13.88.195:58107)
0923 19:42:29.730970 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:29.731009 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:29.733247 (+ 2238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:29.734090 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:29.734105 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:29.735078 (+ 973us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:29.735954 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.735971 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.737113 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.737121 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.738559 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.738570 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.739631 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.739640 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.739978 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.740851 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:29.740900 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:29.744241 (+ 3341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:29.748698 (+ 4457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.748709 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.748735 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.749549 (+ 814us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.750019 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.750025 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.750034 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.750335 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.751118 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:29.751129 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:29.751779 (+ 650us) client_negotiation.cc:769] Sending connection context
0923 19:42:29.752196 (+ 417us) client_negotiation.cc:240] Negotiation successful
0923 19:42:29.752904 (+ 708us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":378,"threads_started":1}
I20260923 19:42:29.769444 21433 heartbeater.cc:503] Master 127.13.88.254:41869 was elected leader, sending a full tablet report...
I20260923 19:42:29.771330 21576 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:37587
I20260923 19:42:29.771360 21707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:37587 every 8 connection(s)
I20260923 19:42:29.773469 21576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:29.776269 21708 heartbeater.cc:347] Connected to a master server at 127.13.88.254:41869
I20260923 19:42:29.776392 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 21576
I20260923 19:42:29.776510 21708 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:29.776553 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:29.777097 13667 external_mini_cluster.cc:1428] Setting key fc1c47f66c700e4985cfca302b21518b
I20260923 19:42:29.777415 21708 heartbeater.cc:511] Master 127.13.88.254:41869 requested a full tablet report, sending...
I20260923 19:42:29.778981 21226 ts_manager.cc:194] Registered new tserver with Master: a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:29.779923 21226 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:58107
I20260923 19:42:29.782102 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:42:29.791460 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.778157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:53523 (local address 127.13.88.254:41869)
0923 19:42:29.778752 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:29.778758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:29.778861 (+ 103us) server_negotiation.cc:407] Connection header received
0923 19:42:29.779164 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:29.779170 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:29.779258 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:29.779368 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:29.780220 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.781252 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.784050 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.784470 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.784609 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.786292 (+ 1683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:29.786302 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:29.786305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:29.786335 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:29.788954 (+ 2619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.789601 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.789608 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.789612 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.789739 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:29.790148 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:29.790152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:29.790154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:29.790421 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:29.790544 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:29.790976 (+ 432us) server_negotiation.cc:299] Negotiation successful
0923 19:42:29.791220 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":491}
I20260923 19:42:29.791806 21712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:29.778095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41869 (local address 127.13.88.195:53523)
0923 19:42:29.778753 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:29.778778 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:29.778967 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:29.779390 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:29.779394 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:29.779825 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:29.780081 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.780094 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.781386 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.781392 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.783897 (+ 2505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:29.783911 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.784641 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.784648 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:29.784813 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:29.785449 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:29.785465 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:29.786117 (+ 652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:29.789080 (+ 2963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.789087 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.789091 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.789465 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.789873 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:29.789880 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:29.789886 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:29.790036 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:29.790541 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:29.790548 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:29.790744 (+ 196us) client_negotiation.cc:769] Sending connection context
0923 19:42:29.790901 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 19:42:29.791253 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":654,"threads_started":1}
Sep 23 19:42:29 dist-test-slave-xg7f krb5kdc[21181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192549, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 19:42:29 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:29 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:30.284739 21572 heartbeater.cc:503] Master 127.13.88.254:41869 was elected leader, sending a full tablet report...
I20260923 19:42:30.782927 21708 heartbeater.cc:503] Master 127.13.88.254:41869 was elected leader, sending a full tablet report...
W20260923 19:42:30.864120 21719 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.038s user 0.000s sys 0.014s
W20260923 19:42:30.865338 21320 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:29.820202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47860 (local address 127.13.88.254:41869)
0923 19:42:29.820448 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:29.820455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:29.820639 (+ 184us) server_negotiation.cc:407] Connection header received
0923 19:42:29.820876 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:29.820880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:29.820943 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:29.821049 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:29.822333 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.823058 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.824396 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:29.824826 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:29.824953 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.865043 (+1040090us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47860: BlockingRecv error: recv got EOF from 127.0.0.1:47860 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Sep 23 19:42:30 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192549, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:30.881987 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:30.868814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47874 (local address 127.13.88.254:41869)
0923 19:42:30.869138 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:30.869145 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:30.869392 (+ 247us) server_negotiation.cc:407] Connection header received
0923 19:42:30.869611 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:30.869616 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:30.869687 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:30.869794 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:30.870990 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.871818 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.873087 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.873514 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.873643 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.877387 (+ 3744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:30.877392 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:30.877395 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:30.877428 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:30.879977 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:30.880575 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:30.880578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:30.880580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:30.880688 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:30.880973 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:30.880975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:30.880977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:30.881214 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:30.881419 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:30.881621 (+ 202us) server_negotiation.cc:299] Negotiation successful
0923 19:42:30.881773 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260923 19:42:30.886283 21226 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:42:30.895411 21226 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:30.920711 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:30.907656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37587 (local address 127.0.0.1:34540)
0923 19:42:30.913077 (+ 5421us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:30.913097 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:30.913295 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:30.913934 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:30.913941 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:30.913973 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:30.914513 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:30.914527 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.916033 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.916039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:30.917619 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:30.917630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.919853 (+ 2223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.919861 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:30.920082 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.920147 (+ 65us) client_negotiation.cc:769] Sending connection context
0923 19:42:30.920268 (+ 121us) client_negotiation.cc:240] Negotiation successful
0923 19:42:30.920422 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5265,"mutex_wait_us":23,"thread_start_us":1388,"threads_started":1}
I20260923 19:42:30.920773 21735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:30.908797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34540 (local address 127.13.88.195:37587)
0923 19:42:30.909395 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:30.909407 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:30.913190 (+ 3783us) server_negotiation.cc:407] Connection header received
0923 19:42:30.913499 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:30.913507 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:30.913719 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:30.913930 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:30.914692 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.915910 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.917945 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.919265 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.919402 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.919607 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:30.920308 (+ 701us) server_negotiation.cc:299] Negotiation successful
0923 19:42:30.920474 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":867,"threads_started":1}
I20260923 19:42:30.921463 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:30.907453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44263 (local address 127.0.0.1:42638)
0923 19:42:30.908477 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:30.908540 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:30.908697 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:30.912361 (+ 3664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:30.912372 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:30.912435 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:30.913018 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:30.913030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.915474 (+ 2444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.915483 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:30.918392 (+ 2909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:30.918410 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.920659 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.920669 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:30.920830 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.920862 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:42:30.920948 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 19:42:30.921072 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"mutex_wait_us":1,"thread_start_us":5251,"threads_started":1}
I20260923 19:42:30.922089 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:30.908184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42638 (local address 127.13.88.193:44263)
0923 19:42:30.911621 (+ 3437us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:30.911631 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:30.911664 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:42:30.911801 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:30.911812 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:30.912102 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:30.912312 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:30.913187 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.915327 (+ 2140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.918613 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.920197 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.920331 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.920516 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:30.921675 (+ 1159us) server_negotiation.cc:299] Negotiation successful
0923 19:42:30.921823 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3262,"thread_start_us":3073,"threads_started":1}
I20260923 19:42:30.925012 21641 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcb57ccb4ce47fa98932536267202c9 (DEFAULT_TABLE table=test-table [id=2feb544660f1432dae43c28c43c38bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:30.925554 21363 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcb57ccb4ce47fa98932536267202c9 (DEFAULT_TABLE table=test-table [id=2feb544660f1432dae43c28c43c38bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:30.926551 21641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcb57ccb4ce47fa98932536267202c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:30.926819 21363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcb57ccb4ce47fa98932536267202c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:30.927815 21734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:30.908649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34998 (local address 127.13.88.194:46817)
0923 19:42:30.919608 (+ 10959us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:30.919617 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:30.920184 (+ 567us) server_negotiation.cc:407] Connection header received
0923 19:42:30.921050 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:30.921058 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:30.921331 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:30.921540 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:30.922421 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.923677 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.925589 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.926694 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.926856 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.927057 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:30.927366 (+ 309us) server_negotiation.cc:299] Negotiation successful
0923 19:42:30.927515 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10808,"thread_start_us":10688,"threads_started":1}
I20260923 19:42:30.927830 21732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:30.908111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:46817 (local address 127.0.0.1:34998)
0923 19:42:30.920058 (+ 11947us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:30.920075 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:30.920188 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:30.921842 (+ 1654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:30.921846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:30.921872 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:30.922208 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:30.922219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.923839 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.923844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:30.925438 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:30.925449 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:30.926956 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:30.926963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:30.927176 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:30.927209 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 19:42:30.927324 (+ 115us) client_negotiation.cc:240] Negotiation successful
0923 19:42:30.927451 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11825,"thread_start_us":11651,"threads_started":1}
I20260923 19:42:30.933835 21502 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcb57ccb4ce47fa98932536267202c9 (DEFAULT_TABLE table=test-table [id=2feb544660f1432dae43c28c43c38bb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:30.934998 21502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcb57ccb4ce47fa98932536267202c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:30.941175 21736 tablet_bootstrap.cc:492] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Bootstrap starting.
I20260923 19:42:30.941874 21737 tablet_bootstrap.cc:492] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Bootstrap starting.
I20260923 19:42:30.945634 21736 tablet_bootstrap.cc:654] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:30.945824 21737 tablet_bootstrap.cc:654] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:30.946784 21736 log.cc:824] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:30.947427 21737 log.cc:824] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:30.949368 21736 tablet_bootstrap.cc:492] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: No bootstrap required, opened a new log
I20260923 19:42:30.949659 21736 ts_tablet_manager.cc:1397] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260923 19:42:30.950111 21740 tablet_bootstrap.cc:492] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Bootstrap starting.
I20260923 19:42:30.953490 21740 tablet_bootstrap.cc:654] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:30.954668 21740 log.cc:824] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:30.956265 21737 tablet_bootstrap.cc:492] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: No bootstrap required, opened a new log
I20260923 19:42:30.956990 21737 ts_tablet_manager.cc:1397] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.004s
I20260923 19:42:30.957545 21740 tablet_bootstrap.cc:492] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: No bootstrap required, opened a new log
I20260923 19:42:30.957798 21740 ts_tablet_manager.cc:1397] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260923 19:42:30.959297 21736 raft_consensus.cc:348] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:30.959625 21736 raft_consensus.cc:374] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:30.959740 21736 raft_consensus.cc:729] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d96c23276914ea3a8a51e7c0fc58f97, State: Initialized, Role: FOLLOWER
I20260923 19:42:30.960510 21736 consensus_queue.cc:260] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:30.962219 21736 ts_tablet_manager.cc:1428] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260923 19:42:30.967432 21737 raft_consensus.cc:348] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:30.967870 21737 raft_consensus.cc:374] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:30.967974 21737 raft_consensus.cc:729] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a40dd9963ceb46d4bc83174e7f5d9357, State: Initialized, Role: FOLLOWER
I20260923 19:42:30.968179 21740 raft_consensus.cc:348] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:30.968600 21740 raft_consensus.cc:374] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:30.968715 21740 raft_consensus.cc:729] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Initialized, Role: FOLLOWER
I20260923 19:42:30.968619 21737 consensus_queue.cc:260] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:30.969271 21740 consensus_queue.cc:260] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:30.970373 21737 ts_tablet_manager.cc:1428] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
I20260923 19:42:30.971155 21740 ts_tablet_manager.cc:1428] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260923 19:42:31.012177 21434 tablet.cc:2369] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:42:31.026219 21709 tablet.cc:2369] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:42:31.029395 21573 tablet.cc:2369] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:42:31.102945 21744 raft_consensus.cc:482] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:31.103271 21744 raft_consensus.cc:504] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:31.105242 21744 leader_election.cc:288] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:31.112231 21735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.105815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:33523 (local address 127.13.88.195:37587)
0923 19:42:31.106040 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.106049 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.106880 (+ 831us) server_negotiation.cc:407] Connection header received
0923 19:42:31.107063 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.107066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.107181 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.107320 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:31.107976 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.108650 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.110489 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.111299 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.111430 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.111512 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.111843 (+ 331us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.111973 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:42:31.112255 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.105713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:33305 (local address 127.13.88.193:44263)
0923 19:42:31.105958 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.105965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.106780 (+ 815us) server_negotiation.cc:407] Connection header received
0923 19:42:31.107008 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.107015 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.107142 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.107239 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:31.107868 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.108608 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.110527 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.111325 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.111493 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.111558 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.111917 (+ 359us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.112041 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:31.112345 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.105802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37587 (local address 127.13.88.194:33523)
0923 19:42:31.106762 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.106779 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.106908 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.107360 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.107364 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.107394 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:31.107831 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.107842 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.108811 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.108814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.110341 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.110360 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.111497 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.111503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.111661 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.111693 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.111783 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.111925 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":37,"thread_start_us":402,"threads_started":1}
I20260923 19:42:31.112394 21746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.105617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44263 (local address 127.13.88.194:33305)
0923 19:42:31.106647 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.106669 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.106847 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.107295 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.107303 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.107328 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:31.107714 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.107726 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.108731 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.108738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.110368 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.110378 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.111549 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.111560 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.111713 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.111753 (+ 40us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.111864 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.111982 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"mutex_wait_us":7,"thread_start_us":871,"threads_started":1}
I20260923 19:42:31.113303 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcb57ccb4ce47fa98932536267202c9" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" is_pre_election: true
I20260923 19:42:31.113301 21386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcb57ccb4ce47fa98932536267202c9" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" is_pre_election: true
I20260923 19:42:31.113775 21386 raft_consensus.cc:2454] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 0.
I20260923 19:42:31.113782 21661 raft_consensus.cc:2454] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 0.
I20260923 19:42:31.114374 21453 leader_election.cc:302] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a2991ce6662a4a2db069ecea6aa39162; no voters:
I20260923 19:42:31.114763 21744 raft_consensus.cc:2781] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:31.114879 21744 raft_consensus.cc:482] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:31.114946 21744 raft_consensus.cc:3037] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.117098 21744 raft_consensus.cc:504] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:31.117663 21744 leader_election.cc:288] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 election: Requested vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:31.118052 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcb57ccb4ce47fa98932536267202c9" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357"
I20260923 19:42:31.118053 21386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcb57ccb4ce47fa98932536267202c9" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97"
I20260923 19:42:31.118249 21386 raft_consensus.cc:3037] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.118234 21661 raft_consensus.cc:3037] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.120414 21661 raft_consensus.cc:2454] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 1.
I20260923 19:42:31.120415 21386 raft_consensus.cc:2454] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 1.
I20260923 19:42:31.120805 21456 leader_election.cc:302] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2991ce6662a4a2db069ecea6aa39162, a40dd9963ceb46d4bc83174e7f5d9357; no voters:
I20260923 19:42:31.121120 21744 raft_consensus.cc:2781] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:31.121556 21744 raft_consensus.cc:686] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 1 LEADER]: Becoming Leader. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Running, Role: LEADER
I20260923 19:42:31.121994 21744 consensus_queue.cc:237] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } }
I20260923 19:42:31.126284 21225 catalog_manager.cc:5495] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "a2991ce6662a4a2db069ecea6aa39162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } health_report { overall_health: HEALTHY } } }
I20260923 19:42:31.153724 21734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.148983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35014 (local address 127.13.88.194:46817)
0923 19:42:31.149154 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.149158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.149265 (+ 107us) server_negotiation.cc:407] Connection header received
0923 19:42:31.149447 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.149450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.149536 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.149659 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:31.149968 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.150632 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.151962 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.152342 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.152443 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.152799 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:31.153303 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:31.153408 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.153468 (+ 60us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.153527 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:42:31.161456 21661 raft_consensus.cc:1261] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Refusing update from remote peer a2991ce6662a4a2db069ecea6aa39162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:31.161456 21386 raft_consensus.cc:1261] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Refusing update from remote peer a2991ce6662a4a2db069ecea6aa39162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:31.162451 21747 consensus_queue.cc:1035] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:31.162761 21744 consensus_queue.cc:1035] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:31.187139 21752 mvcc.cc:205] Tried to move back new op lower bound from 7332628689548009472 to 7332628689399136256. Current Snapshot: MvccSnapshot[applied={T|T < 7332628689548009472}]
I20260923 19:42:31.197146 21226 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:31.197397 21226 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:31.200810 21226 catalog_manager.cc:5782] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Sending DeleteTablet for 3 replicas of tablet 4bcb57ccb4ce47fa98932536267202c9
I20260923 19:42:31.201977 21363 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bcb57ccb4ce47fa98932536267202c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:31 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:42638
I20260923 19:42:31.202242 21641 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bcb57ccb4ce47fa98932536267202c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:31 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34540
I20260923 19:42:31.202250 21502 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bcb57ccb4ce47fa98932536267202c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:31 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34998
I20260923 19:42:31.204592 21226 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:42:31.205494 21226 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:31.213419 21362 tablet_service.cc:1467] Processing CreateTablet for tablet 83c24e8da8bc43289fdff77ba7abf259 (DEFAULT_TABLE table=test-table [id=c93b55367b414156a34e928e2bdc57e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:31.214084 21362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83c24e8da8bc43289fdff77ba7abf259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.214617 21759 tablet_replica.cc:330] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: stopping tablet replica
I20260923 19:42:31.215222 21759 raft_consensus.cc:2229] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:31.215821 21759 raft_consensus.cc:2258] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:31.216040 21501 tablet_service.cc:1467] Processing CreateTablet for tablet 83c24e8da8bc43289fdff77ba7abf259 (DEFAULT_TABLE table=test-table [id=c93b55367b414156a34e928e2bdc57e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:31.216360 21760 tablet_replica.cc:330] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: stopping tablet replica
I20260923 19:42:31.216671 21501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83c24e8da8bc43289fdff77ba7abf259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.216815 21760 raft_consensus.cc:2229] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:31.217298 21760 raft_consensus.cc:2258] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:31.218055 21759 ts_tablet_manager.cc:1905] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:31.219264 21760 ts_tablet_manager.cc:1905] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:31.223707 21761 tablet_replica.cc:330] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: stopping tablet replica
I20260923 19:42:31.224188 21641 tablet_service.cc:1467] Processing CreateTablet for tablet 83c24e8da8bc43289fdff77ba7abf259 (DEFAULT_TABLE table=test-table [id=c93b55367b414156a34e928e2bdc57e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:31.224233 21761 raft_consensus.cc:2229] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:31.224903 21761 raft_consensus.cc:2258] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:31.225047 21759 ts_tablet_manager.cc:1918] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:31.225217 21759 log.cc:1196] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/4bcb57ccb4ce47fa98932536267202c9
I20260923 19:42:31.225824 21759 ts_tablet_manager.cc:1939] T 4bcb57ccb4ce47fa98932536267202c9 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting consensus metadata
I20260923 19:42:31.227366 21641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83c24e8da8bc43289fdff77ba7abf259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.227240 21761 ts_tablet_manager.cc:1905] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:31.228968 21210 catalog_manager.cc:4841] TS 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263): tablet 4bcb57ccb4ce47fa98932536267202c9 (table test-table [id=2feb544660f1432dae43c28c43c38bb2]) successfully deleted
I20260923 19:42:31.230087 21736 tablet_bootstrap.cc:492] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: Bootstrap starting.
I20260923 19:42:31.231634 21736 tablet_bootstrap.cc:654] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.232750 21740 tablet_bootstrap.cc:492] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: Bootstrap starting.
I20260923 19:42:31.233009 21760 ts_tablet_manager.cc:1918] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:31.233183 21760 log.cc:1196] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/4bcb57ccb4ce47fa98932536267202c9
I20260923 19:42:31.233764 21760 ts_tablet_manager.cc:1939] T 4bcb57ccb4ce47fa98932536267202c9 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting consensus metadata
I20260923 19:42:31.234493 21740 tablet_bootstrap.cc:654] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.234650 21736 tablet_bootstrap.cc:492] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: No bootstrap required, opened a new log
I20260923 19:42:31.234768 21736 ts_tablet_manager.cc:1397] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:42:31.235731 21213 catalog_manager.cc:4841] TS a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587): tablet 4bcb57ccb4ce47fa98932536267202c9 (table test-table [id=2feb544660f1432dae43c28c43c38bb2]) successfully deleted
I20260923 19:42:31.236078 21737 tablet_bootstrap.cc:492] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: Bootstrap starting.
I20260923 19:42:31.235581 21736 raft_consensus.cc:348] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.236305 21736 raft_consensus.cc:374] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.236404 21736 raft_consensus.cc:729] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d96c23276914ea3a8a51e7c0fc58f97, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.236668 21736 consensus_queue.cc:260] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.237596 21737 tablet_bootstrap.cc:654] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.239533 21736 ts_tablet_manager.cc:1428] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:42:31.239553 21761 ts_tablet_manager.cc:1918] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:31.239701 21761 log.cc:1196] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/4bcb57ccb4ce47fa98932536267202c9
I20260923 19:42:31.240236 21761 ts_tablet_manager.cc:1939] T 4bcb57ccb4ce47fa98932536267202c9 P a2991ce6662a4a2db069ecea6aa39162: Deleting consensus metadata
I20260923 19:42:31.242010 21211 catalog_manager.cc:4841] TS a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817): tablet 4bcb57ccb4ce47fa98932536267202c9 (table test-table [id=2feb544660f1432dae43c28c43c38bb2]) successfully deleted
I20260923 19:42:31.243609 21737 tablet_bootstrap.cc:492] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: No bootstrap required, opened a new log
I20260923 19:42:31.243783 21737 ts_tablet_manager.cc:1397] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20260923 19:42:31.244280 21740 tablet_bootstrap.cc:492] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: No bootstrap required, opened a new log
I20260923 19:42:31.244421 21740 ts_tablet_manager.cc:1397] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.003s
I20260923 19:42:31.244483 21737 raft_consensus.cc:348] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.244947 21737 raft_consensus.cc:374] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.245088 21737 raft_consensus.cc:729] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a40dd9963ceb46d4bc83174e7f5d9357, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.245246 21740 raft_consensus.cc:348] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.245517 21740 raft_consensus.cc:374] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.245401 21737 consensus_queue.cc:260] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.245618 21740 raft_consensus.cc:729] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.245909 21740 consensus_queue.cc:260] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.246148 21747 raft_consensus.cc:482] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:31.246282 21747 raft_consensus.cc:504] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.246433 21737 ts_tablet_manager.cc:1428] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:31.246989 21747 leader_election.cc:288] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:31.247445 21386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c24e8da8bc43289fdff77ba7abf259" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" is_pre_election: true
I20260923 19:42:31.247645 21386 raft_consensus.cc:2454] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 0.
I20260923 19:42:31.247602 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c24e8da8bc43289fdff77ba7abf259" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" is_pre_election: true
I20260923 19:42:31.247818 21661 raft_consensus.cc:2454] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 0.
I20260923 19:42:31.248040 21453 leader_election.cc:302] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a2991ce6662a4a2db069ecea6aa39162; no voters:
I20260923 19:42:31.248818 21747 raft_consensus.cc:2781] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:31.248943 21747 raft_consensus.cc:482] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:31.249097 21747 raft_consensus.cc:3037] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.252048 21747 raft_consensus.cc:504] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.253057 21386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c24e8da8bc43289fdff77ba7abf259" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97"
I20260923 19:42:31.253196 21740 ts_tablet_manager.cc:1428] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260923 19:42:31.253261 21386 raft_consensus.cc:3037] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.253590 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83c24e8da8bc43289fdff77ba7abf259" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357"
I20260923 19:42:31.253756 21661 raft_consensus.cc:3037] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.255497 21386 raft_consensus.cc:2454] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 1.
I20260923 19:42:31.255925 21453 leader_election.cc:302] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a2991ce6662a4a2db069ecea6aa39162; no voters:
I20260923 19:42:31.256181 21744 raft_consensus.cc:2781] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:31.256875 21661 raft_consensus.cc:2454] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 1.
I20260923 19:42:31.257145 21744 raft_consensus.cc:686] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 1 LEADER]: Becoming Leader. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Running, Role: LEADER
I20260923 19:42:31.257414 21744 consensus_queue.cc:237] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.258719 21747 leader_election.cc:288] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 election: Requested vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:31.260023 21225 catalog_manager.cc:5495] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "a2991ce6662a4a2db069ecea6aa39162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } health_report { overall_health: UNKNOWN } } }
Sep 23 19:42:31 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192548, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.254@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:31.315894 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.301653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47888 (local address 127.13.88.254:41869)
0923 19:42:31.301937 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.301946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.302589 (+ 643us) server_negotiation.cc:407] Connection header received
0923 19:42:31.302734 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.302739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.302827 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.302947 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:31.304291 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.305133 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.306552 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.306927 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.307057 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.310477 (+ 3420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:31.310481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:31.310484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:31.310510 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:31.313282 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:31.313915 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:31.313922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:31.313927 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:31.314034 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:31.314384 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:31.314388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:31.314392 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:31.314625 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:31.314780 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.315203 (+ 423us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.315540 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":129,"server-negotiator.queue_time_us":134}
I20260923 19:42:31.315913 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.301692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41869 (local address 127.0.0.1:47888)
0923 19:42:31.302447 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.302469 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.302620 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.302979 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.302982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.303834 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:31.304144 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.304153 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.305359 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.305364 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.306429 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.306440 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.307122 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.307129 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.307276 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.307951 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:31.307969 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:31.310303 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:31.313410 (+ 3107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:31.313423 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:31.313430 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:31.313807 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:31.314129 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:31.314136 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:31.314139 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:31.314279 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:31.314740 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:31.314762 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:31.314942 (+ 180us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.315105 (+ 163us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.315409 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":456,"threads_started":1}
I20260923 19:42:31.321328 21225 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:47888:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 19:42:31.322332 21225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:31.329094 21362 tablet_service.cc:1467] Processing CreateTablet for tablet 0fb6123d2751469fbf1f0058c429c543 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=daeb72dcef534332bf3487dbcc0213c2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:42:31.329563 21362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fb6123d2751469fbf1f0058c429c543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.329470 21641 tablet_service.cc:1467] Processing CreateTablet for tablet 0fb6123d2751469fbf1f0058c429c543 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=daeb72dcef534332bf3487dbcc0213c2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:42:31.329988 21641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fb6123d2751469fbf1f0058c429c543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.334520 21501 tablet_service.cc:1467] Processing CreateTablet for tablet 0fb6123d2751469fbf1f0058c429c543 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=daeb72dcef534332bf3487dbcc0213c2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 19:42:31.335049 21501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fb6123d2751469fbf1f0058c429c543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.335551 21736 tablet_bootstrap.cc:492] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: Bootstrap starting.
I20260923 19:42:31.337065 21737 tablet_bootstrap.cc:492] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: Bootstrap starting.
I20260923 19:42:31.337242 21736 tablet_bootstrap.cc:654] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.338670 21737 tablet_bootstrap.cc:654] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.343461 21740 tablet_bootstrap.cc:492] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: Bootstrap starting.
I20260923 19:42:31.345499 21740 tablet_bootstrap.cc:654] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.350008 21737 tablet_bootstrap.cc:492] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: No bootstrap required, opened a new log
I20260923 19:42:31.350168 21737 ts_tablet_manager.cc:1397] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260923 19:42:31.350871 21737 raft_consensus.cc:348] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.351133 21737 raft_consensus.cc:374] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.351272 21737 raft_consensus.cc:729] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a40dd9963ceb46d4bc83174e7f5d9357, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.351580 21737 consensus_queue.cc:260] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.352192 21743 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.352605 21743 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:42:31.353194 21737 ts_tablet_manager.cc:1428] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:31.355584 21740 tablet_bootstrap.cc:492] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: No bootstrap required, opened a new log
I20260923 19:42:31.355875 21740 ts_tablet_manager.cc:1397] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.001s
I20260923 19:42:31.356846 21740 raft_consensus.cc:348] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.357132 21740 raft_consensus.cc:374] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.357235 21740 raft_consensus.cc:729] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.357609 21740 consensus_queue.cc:260] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.358155 21747 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.358541 21747 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:42:31.359817 21740 ts_tablet_manager.cc:1428] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:42:31.361389 21736 tablet_bootstrap.cc:492] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: No bootstrap required, opened a new log
I20260923 19:42:31.361589 21736 ts_tablet_manager.cc:1397] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.016s
I20260923 19:42:31.362141 21736 raft_consensus.cc:348] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.362341 21736 raft_consensus.cc:374] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.362459 21736 raft_consensus.cc:729] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d96c23276914ea3a8a51e7c0fc58f97, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.362715 21736 consensus_queue.cc:260] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.363433 21736 ts_tablet_manager.cc:1428] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260923 19:42:31.363261 21742 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.363632 21742 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:42:31.520629 21742 raft_consensus.cc:482] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:31.520838 21742 raft_consensus.cc:504] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.522388 21742 leader_election.cc:288] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:31.531719 21734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.523008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:57159 (local address 127.13.88.194:46817)
0923 19:42:31.523329 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.523335 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.524137 (+ 802us) server_negotiation.cc:407] Connection header received
0923 19:42:31.524513 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.524519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.524600 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.524723 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:31.525675 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.526508 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.529464 (+ 2956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.530625 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.530782 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.530860 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.531237 (+ 377us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.531365 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260923 19:42:31.531736 21735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.523353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:42029 (local address 127.13.88.195:37587)
0923 19:42:31.523526 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.523531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.524574 (+ 1043us) server_negotiation.cc:407] Connection header received
0923 19:42:31.524763 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.524767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.524821 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.524920 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:31.525640 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.526744 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.529311 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.530444 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.530613 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.530697 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.531288 (+ 591us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.531429 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 19:42:31.531757 21776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.522776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:46817 (local address 127.13.88.193:57159)
0923 19:42:31.524007 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.524027 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.524287 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.525087 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.525090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.525128 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:31.525540 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.525553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.526632 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.526639 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.529309 (+ 2670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.529324 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.530874 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.530883 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.531025 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.531078 (+ 53us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.531208 (+ 130us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.531332 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1104,"mutex_wait_us":107,"thread_start_us":944,"threads_started":1}
I20260923 19:42:31.532476 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.522962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37587 (local address 127.13.88.193:42029)
0923 19:42:31.524474 (+ 1512us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.524498 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.524622 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.524942 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.524947 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.524971 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:31.525425 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.525442 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.526895 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.526900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.529155 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.529166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.530858 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.530866 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.531071 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.531128 (+ 57us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.531981 (+ 853us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.532108 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1389,"mutex_wait_us":6,"thread_start_us":1196,"threads_started":1}
I20260923 19:42:31.532855 21522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fb6123d2751469fbf1f0058c429c543" candidate_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2991ce6662a4a2db069ecea6aa39162" is_pre_election: true
I20260923 19:42:31.533098 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fb6123d2751469fbf1f0058c429c543" candidate_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" is_pre_election: true
I20260923 19:42:31.533339 21661 raft_consensus.cc:2454] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d96c23276914ea3a8a51e7c0fc58f97 in term 0.
I20260923 19:42:31.533340 21522 raft_consensus.cc:2454] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d96c23276914ea3a8a51e7c0fc58f97 in term 0.
I20260923 19:42:31.533885 21316 leader_election.cc:302] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a40dd9963ceb46d4bc83174e7f5d9357; no voters:
I20260923 19:42:31.534343 21742 raft_consensus.cc:2781] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:31.534484 21742 raft_consensus.cc:482] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:31.534593 21742 raft_consensus.cc:3037] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.536861 21742 raft_consensus.cc:504] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.537484 21742 leader_election.cc:288] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [CANDIDATE]: Term 1 election: Requested vote from peers a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:31.537926 21522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fb6123d2751469fbf1f0058c429c543" candidate_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2991ce6662a4a2db069ecea6aa39162"
I20260923 19:42:31.538029 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fb6123d2751469fbf1f0058c429c543" candidate_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357"
I20260923 19:42:31.538148 21522 raft_consensus.cc:3037] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.538245 21661 raft_consensus.cc:3037] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:31.541141 21661 raft_consensus.cc:2454] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d96c23276914ea3a8a51e7c0fc58f97 in term 1.
I20260923 19:42:31.541368 21522 raft_consensus.cc:2454] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d96c23276914ea3a8a51e7c0fc58f97 in term 1.
I20260923 19:42:31.541544 21316 leader_election.cc:302] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a40dd9963ceb46d4bc83174e7f5d9357; no voters:
I20260923 19:42:31.541985 21742 raft_consensus.cc:2781] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:31.542456 21742 raft_consensus.cc:686] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 LEADER]: Becoming Leader. State: Replica: 1d96c23276914ea3a8a51e7c0fc58f97, State: Running, Role: LEADER
I20260923 19:42:31.542994 21742 consensus_queue.cc:237] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.545069 21778 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: TxnStatusTablet state changed. Reason: New leader 1d96c23276914ea3a8a51e7c0fc58f97. Latest consensus state: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.545444 21778 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:42:31.546067 21780 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 19:42:31.546279 21780 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 19:42:31.546880 21225 catalog_manager.cc:5495] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193). New cstate: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260923 19:42:31.590268 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.583049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50076 (local address 127.13.88.193:44263)
0923 19:42:31.583238 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.583244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.583281 (+ 37us) server_negotiation.cc:407] Connection header received
0923 19:42:31.583402 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.583407 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.583516 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.583679 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:31.584131 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.585324 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.587378 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.588047 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.588180 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.588751 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:31.589529 (+ 778us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:31.589686 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.589830 (+ 144us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.589919 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 19:42:31.590327 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.582750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44263 (local address 127.0.0.1:50076)
0923 19:42:31.582998 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.583019 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.583182 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.583716 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.583722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.583737 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:42:31.583965 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.583981 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.585495 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.585502 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.587211 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.587228 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.588222 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.588229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.588437 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.588522 (+ 85us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:42:31.589663 (+ 1141us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:42:31.589686 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.589794 (+ 108us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.590021 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 19:42:31.595211 21661 raft_consensus.cc:1261] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Refusing update from remote peer 1d96c23276914ea3a8a51e7c0fc58f97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:31.595587 21522 raft_consensus.cc:1261] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Refusing update from remote peer 1d96c23276914ea3a8a51e7c0fc58f97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:31.596077 21742 consensus_queue.cc:1035] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:31.596501 21778 consensus_queue.cc:1035] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:31.610106 21747 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: TxnStatusTablet state changed. Reason: New leader 1d96c23276914ea3a8a51e7c0fc58f97. Latest consensus state: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.610391 21747 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:42:31.610407 21743 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: TxnStatusTablet state changed. Reason: New leader 1d96c23276914ea3a8a51e7c0fc58f97. Latest consensus state: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.610692 21743 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:42:31.612452 21778 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.612699 21778 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:42:31.612903 21751 mvcc.cc:205] Tried to move back new op lower bound from 7332628691325743104 to 7332628691123605504. Current Snapshot: MvccSnapshot[applied={T|T < 7332628691325743104 or (T in {7332628691325743104})}]
I20260923 19:42:31.615640 21747 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.615909 21747 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P a2991ce6662a4a2db069ecea6aa39162: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:42:31.619557 21778 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.619809 21778 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P 1d96c23276914ea3a8a51e7c0fc58f97: This TxnStatusTablet replica's current role is: LEADER
I20260923 19:42:31.623746 21743 tablet_replica.cc:439] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } } }
I20260923 19:42:31.623987 21743 tablet_replica.cc:442] T 0fb6123d2751469fbf1f0058c429c543 P a40dd9963ceb46d4bc83174e7f5d9357: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 19:42:31.637135 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.630821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:51399 (local address 127.13.88.193:44263)
0923 19:42:31.631065 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.631074 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.631712 (+ 638us) server_negotiation.cc:407] Connection header received
0923 19:42:31.631962 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.631967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.632045 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.632156 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:31.632611 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.633494 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.635286 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.635804 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.635939 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.636399 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:31.636503 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:31.636600 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.636723 (+ 123us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.636800 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260923 19:42:31.637245 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.630832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44263 (local address 127.13.88.194:51399)
0923 19:42:31.631593 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.631612 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.631817 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.632173 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.632178 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.632189 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:42:31.632462 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.632471 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.633608 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.633614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.635151 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.635165 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.635949 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.635955 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.636137 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.636205 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:42:31.636599 (+ 394us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:42:31.636611 (+ 12us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.636686 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.636833 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":452,"threads_started":1}
I20260923 19:42:31.648475 21661 raft_consensus.cc:1261] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Refusing update from remote peer a2991ce6662a4a2db069ecea6aa39162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:31.648484 21386 raft_consensus.cc:1261] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Refusing update from remote peer a2991ce6662a4a2db069ecea6aa39162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:31.649104 21744 consensus_queue.cc:1035] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:31.649598 21747 consensus_queue.cc:1035] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:31.699999 21734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.693364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:60865 (local address 127.13.88.194:46817)
0923 19:42:31.693585 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.693591 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.694215 (+ 624us) server_negotiation.cc:407] Connection header received
0923 19:42:31.694403 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.694409 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.694491 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.694583 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:31.695500 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.696298 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.698023 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.698590 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.698717 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.699310 (+ 593us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:31.699446 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:31.699508 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.699719 (+ 211us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.699785 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 19:42:31.700285 21791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.693412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:46817 (local address 127.13.88.193:60865)
0923 19:42:31.694103 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:31.694120 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:31.694267 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:31.694600 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:31.694604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:31.694616 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:42:31.695088 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.695138 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.696455 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.696462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.697856 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:31.697880 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.698787 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.698796 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:31.698993 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.699067 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:42:31.699584 (+ 517us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:42:31.699599 (+ 15us) client_negotiation.cc:769] Sending connection context
0923 19:42:31.699678 (+ 79us) client_negotiation.cc:240] Negotiation successful
0923 19:42:31.699834 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":338,"threads_started":1}
I20260923 19:42:31.732040 21225 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:31.732242 21225 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:31.735195 21225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Sending DeleteTablet for 3 replicas of tablet 83c24e8da8bc43289fdff77ba7abf259
I20260923 19:42:31.736086 21501 tablet_service.cc:1514] Processing DeleteTablet for tablet 83c24e8da8bc43289fdff77ba7abf259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:31 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34998
I20260923 19:42:31.736178 21641 tablet_service.cc:1514] Processing DeleteTablet for tablet 83c24e8da8bc43289fdff77ba7abf259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:31 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34540
I20260923 19:42:31.736361 21761 tablet_replica.cc:330] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: stopping tablet replica
I20260923 19:42:31.736555 21761 raft_consensus.cc:2229] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:31.736856 21761 raft_consensus.cc:2258] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:31.742609 21760 tablet_replica.cc:330] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: stopping tablet replica
I20260923 19:42:31.742831 21760 raft_consensus.cc:2229] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:31.743027 21760 raft_consensus.cc:2258] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:31.744314 21760 ts_tablet_manager.cc:1905] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:31.744347 21761 ts_tablet_manager.cc:1905] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:31.747394 21362 tablet_service.cc:1514] Processing DeleteTablet for tablet 83c24e8da8bc43289fdff77ba7abf259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:31 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:42638
I20260923 19:42:31.751024 21761 ts_tablet_manager.cc:1918] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:42:31.751289 21761 log.cc:1196] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/83c24e8da8bc43289fdff77ba7abf259
I20260923 19:42:31.751832 21761 ts_tablet_manager.cc:1939] T 83c24e8da8bc43289fdff77ba7abf259 P a2991ce6662a4a2db069ecea6aa39162: Deleting consensus metadata
I20260923 19:42:31.753005 21760 ts_tablet_manager.cc:1918] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:42:31.753244 21760 log.cc:1196] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/83c24e8da8bc43289fdff77ba7abf259
I20260923 19:42:31.753381 21211 catalog_manager.cc:4841] TS a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817): tablet 83c24e8da8bc43289fdff77ba7abf259 (table test-table [id=c93b55367b414156a34e928e2bdc57e0]) successfully deleted
I20260923 19:42:31.753706 21760 ts_tablet_manager.cc:1939] T 83c24e8da8bc43289fdff77ba7abf259 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting consensus metadata
I20260923 19:42:31.754791 21213 catalog_manager.cc:4841] TS a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587): tablet 83c24e8da8bc43289fdff77ba7abf259 (table test-table [id=c93b55367b414156a34e928e2bdc57e0]) successfully deleted
I20260923 19:42:31.755175 21795 tablet_replica.cc:330] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: stopping tablet replica
I20260923 19:42:31.755388 21795 raft_consensus.cc:2229] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:31.755636 21795 raft_consensus.cc:2258] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:31.760114 21795 ts_tablet_manager.cc:1905] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:31.767766 21795 ts_tablet_manager.cc:1918] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:42:31.768010 21795 log.cc:1196] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/83c24e8da8bc43289fdff77ba7abf259
I20260923 19:42:31.768570 21795 ts_tablet_manager.cc:1939] T 83c24e8da8bc43289fdff77ba7abf259 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting consensus metadata
I20260923 19:42:31.769891 21210 catalog_manager.cc:4841] TS 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263): tablet 83c24e8da8bc43289fdff77ba7abf259 (table test-table [id=c93b55367b414156a34e928e2bdc57e0]) successfully deleted
Sep 23 19:42:31 dist-test-slave-xg7f krb5kdc[21181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 19:42:31 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:31 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:42:31.820003 21320 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:31.806132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43088 (local address 127.13.88.254:41869)
0923 19:42:31.806345 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.806352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.807742 (+ 1390us) server_negotiation.cc:407] Connection header received
0923 19:42:31.807905 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.807911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.807989 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.808095 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:31.809733 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.810898 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.812735 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.813419 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.813545 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.819707 (+ 6162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43088: BlockingRecv error: recv got EOF from 127.0.0.1:43088 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Sep 23 19:42:31 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM
I20260923 19:42:31.837752 21320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:31.822696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43098 (local address 127.13.88.254:41869)
0923 19:42:31.822894 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:31.822899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:31.823165 (+ 266us) server_negotiation.cc:407] Connection header received
0923 19:42:31.823345 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:31.823349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:31.823418 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:31.823553 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:31.825085 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.825807 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.827515 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:31.828040 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:31.828168 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:31.832415 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:31.832421 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:31.832424 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:31.832457 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:31.835165 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:31.835840 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:31.835856 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:31.835858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:31.835972 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:31.836345 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:31.836350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:31.836352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:31.836610 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:31.836876 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:31.837157 (+ 281us) server_negotiation.cc:299] Negotiation successful
0923 19:42:31.837410 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:42:31.841274 21225 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:42:31.841905 21225 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:31.848893 21362 tablet_service.cc:1467] Processing CreateTablet for tablet e7e40e3de6004da4bf898e9ed5182145 (DEFAULT_TABLE table=test-table [id=19e247824b09424d9ace8f9153937b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:31.849108 21641 tablet_service.cc:1467] Processing CreateTablet for tablet e7e40e3de6004da4bf898e9ed5182145 (DEFAULT_TABLE table=test-table [id=19e247824b09424d9ace8f9153937b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:31.849445 21362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e40e3de6004da4bf898e9ed5182145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.849351 21501 tablet_service.cc:1467] Processing CreateTablet for tablet e7e40e3de6004da4bf898e9ed5182145 (DEFAULT_TABLE table=test-table [id=19e247824b09424d9ace8f9153937b39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:31.849486 21641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e40e3de6004da4bf898e9ed5182145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.849797 21501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e40e3de6004da4bf898e9ed5182145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:31.855783 21740 tablet_bootstrap.cc:492] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: Bootstrap starting.
I20260923 19:42:31.856761 21736 tablet_bootstrap.cc:492] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Bootstrap starting.
I20260923 19:42:31.857422 21740 tablet_bootstrap.cc:654] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.857950 21736 tablet_bootstrap.cc:654] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.859654 21807 tablet_bootstrap.cc:492] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: Bootstrap starting.
I20260923 19:42:31.860026 21740 tablet_bootstrap.cc:492] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: No bootstrap required, opened a new log
I20260923 19:42:31.860503 21740 ts_tablet_manager.cc:1397] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 19:42:31.861387 21807 tablet_bootstrap.cc:654] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:31.861778 21740 raft_consensus.cc:348] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.862248 21740 raft_consensus.cc:374] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.862445 21740 raft_consensus.cc:729] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.862833 21740 consensus_queue.cc:260] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.863606 21740 ts_tablet_manager.cc:1428] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:31.866556 21736 tablet_bootstrap.cc:492] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: No bootstrap required, opened a new log
I20260923 19:42:31.866811 21736 ts_tablet_manager.cc:1397] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s
I20260923 19:42:31.867901 21736 raft_consensus.cc:348] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.868149 21736 raft_consensus.cc:374] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.868281 21736 raft_consensus.cc:729] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d96c23276914ea3a8a51e7c0fc58f97, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.868614 21736 consensus_queue.cc:260] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.869541 21807 tablet_bootstrap.cc:492] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: No bootstrap required, opened a new log
I20260923 19:42:31.869697 21807 ts_tablet_manager.cc:1397] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260923 19:42:31.869946 21736 ts_tablet_manager.cc:1428] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:42:31.870476 21807 raft_consensus.cc:348] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.870705 21807 raft_consensus.cc:374] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:31.870797 21807 raft_consensus.cc:729] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a40dd9963ceb46d4bc83174e7f5d9357, State: Initialized, Role: FOLLOWER
I20260923 19:42:31.871050 21807 consensus_queue.cc:260] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:31.871733 21807 ts_tablet_manager.cc:1428] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260923 19:42:32.196305 21765 raft_consensus.cc:482] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:32.196488 21765 raft_consensus.cc:504] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.197093 21765 leader_election.cc:288] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:32.197682 21384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e40e3de6004da4bf898e9ed5182145" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" is_pre_election: true
I20260923 19:42:32.197701 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e40e3de6004da4bf898e9ed5182145" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" is_pre_election: true
I20260923 19:42:32.197916 21384 raft_consensus.cc:2454] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 0.
I20260923 19:42:32.197948 21661 raft_consensus.cc:2454] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 0.
I20260923 19:42:32.198400 21453 leader_election.cc:302] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a2991ce6662a4a2db069ecea6aa39162; no voters:
I20260923 19:42:32.198691 21765 raft_consensus.cc:2781] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:32.198817 21765 raft_consensus.cc:482] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:32.198916 21765 raft_consensus.cc:3037] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:32.200937 21765 raft_consensus.cc:504] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.201483 21765 leader_election.cc:288] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 election: Requested vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587)
I20260923 19:42:32.201918 21384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e40e3de6004da4bf898e9ed5182145" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97"
I20260923 19:42:32.201977 21661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e40e3de6004da4bf898e9ed5182145" candidate_uuid: "a2991ce6662a4a2db069ecea6aa39162" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a40dd9963ceb46d4bc83174e7f5d9357"
I20260923 19:42:32.202147 21384 raft_consensus.cc:3037] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:32.202174 21661 raft_consensus.cc:3037] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:32.204272 21384 raft_consensus.cc:2454] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 1.
I20260923 19:42:32.204437 21661 raft_consensus.cc:2454] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2991ce6662a4a2db069ecea6aa39162 in term 1.
I20260923 19:42:32.204777 21453 leader_election.cc:302] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a2991ce6662a4a2db069ecea6aa39162; no voters:
I20260923 19:42:32.205080 21765 raft_consensus.cc:2781] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:32.205333 21765 raft_consensus.cc:686] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 1 LEADER]: Becoming Leader. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Running, Role: LEADER
I20260923 19:42:32.205638 21765 consensus_queue.cc:237] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.208419 21226 catalog_manager.cc:5495] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "a2991ce6662a4a2db069ecea6aa39162" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260923 19:42:32.238883 21813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.234169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56264 (local address 127.13.88.194:46817)
0923 19:42:32.234642 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.234647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.234664 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:42:32.234790 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.234794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.234863 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.234945 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:32.235330 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.236067 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.237301 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.237692 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.237788 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.238173 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:32.238268 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:32.238334 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.238459 (+ 125us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.238521 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":238,"threads_started":1}
I20260923 19:42:32.241817 21661 raft_consensus.cc:1261] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Refusing update from remote peer a2991ce6662a4a2db069ecea6aa39162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:32.241823 21384 raft_consensus.cc:1261] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Refusing update from remote peer a2991ce6662a4a2db069ecea6aa39162: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:32.242414 21765 consensus_queue.cc:1035] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:32.242673 21744 consensus_queue.cc:1035] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:32.249485 21814 mvcc.cc:205] Tried to move back new op lower bound from 7332628693976633344 to 7332628693837189120. Current Snapshot: MvccSnapshot[applied={T|T < 7332628693976633344 or (T in {7332628693976633344})}]
I20260923 19:42:32.253458 21226 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:32.253721 21226 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:32.257829 21226 catalog_manager.cc:5782] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Sending DeleteTablet for 3 replicas of tablet e7e40e3de6004da4bf898e9ed5182145
I20260923 19:42:32.258841 21641 tablet_service.cc:1514] Processing DeleteTablet for tablet e7e40e3de6004da4bf898e9ed5182145 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:32 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34540
I20260923 19:42:32.259274 21362 tablet_service.cc:1514] Processing DeleteTablet for tablet e7e40e3de6004da4bf898e9ed5182145 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:32 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:42638
I20260923 19:42:32.259547 21795 tablet_replica.cc:330] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: stopping tablet replica
I20260923 19:42:32.259727 21795 raft_consensus.cc:2229] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:32.259886 21795 pending_rounds.cc:62] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Trying to abort 2 pending ops.
I20260923 19:42:32.259999 21795 pending_rounds.cc:68] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7332628693976633344 op_type: WRITE_OP write_request { tablet_id: "e7e40e3de6004da4bf898e9ed5182145" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\324\331\320\325\006\"8\n\ntest-admin\022*\n 19e247824b09424d9ace8f9153937b39\020\001\030\001 \001(\001" signature: "<redacted>""2\234\177\273uFT\231\023U\255Z7\235\263\303\275\230\370\324\265e\346\037\271\232\272\344^\271l\3466\0076\313c\221\324L{E\327@,[\362\205\227\007\232\351jB+\300\332\346\203\nU\207\244\010" signing_key_seq_num: 0 } } request_id { client_id: "a1e088ac4d594864bcaf9a42993f26b5" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260923 19:42:32.260097 21224 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:42:32.260700 21795 pending_rounds.cc:68] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332628693837189120 op_type: NO_OP noop_request { }
I20260923 19:42:32.260878 21795 raft_consensus.cc:2866] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260923 19:42:32.260960 21224 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:42:32.261003 21795 raft_consensus.cc:2258] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:42:32.261528 21453 consensus_peers.cc:487] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 -> Peer 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263): Couldn't send request to peer 1d96c23276914ea3a8a51e7c0fc58f97. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:42:32.262049 21821 tablet_replica.cc:330] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: stopping tablet replica
I20260923 19:42:32.262041 21501 tablet_service.cc:1514] Processing DeleteTablet for tablet e7e40e3de6004da4bf898e9ed5182145 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:32 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34998
I20260923 19:42:32.262247 21821 raft_consensus.cc:2229] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:32.262532 21821 raft_consensus.cc:2258] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:32.262603 21822 tablet_replica.cc:330] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: stopping tablet replica
I20260923 19:42:32.262823 21822 raft_consensus.cc:2229] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:32.263247 21795 ts_tablet_manager.cc:1905] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:32.263262 21822 raft_consensus.cc:2258] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:32.263605 21821 ts_tablet_manager.cc:1905] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:32.265038 21822 ts_tablet_manager.cc:1905] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:32.270033 21821 ts_tablet_manager.cc:1918] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:32.270020 21362 tablet_service.cc:1467] Processing CreateTablet for tablet d7dc1236d2a843a59e77079fe2ed9f35 (DEFAULT_TABLE table=test-table [id=082782bfc6234c9094a51d1fe3ef15f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:32.270241 21821 log.cc:1196] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/e7e40e3de6004da4bf898e9ed5182145
I20260923 19:42:32.270459 21362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7dc1236d2a843a59e77079fe2ed9f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:32.270717 21821 ts_tablet_manager.cc:1939] T e7e40e3de6004da4bf898e9ed5182145 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting consensus metadata
I20260923 19:42:32.271701 21822 ts_tablet_manager.cc:1918] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:32.271904 21822 log.cc:1196] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/e7e40e3de6004da4bf898e9ed5182145
I20260923 19:42:32.271857 21213 catalog_manager.cc:4841] TS a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587): tablet e7e40e3de6004da4bf898e9ed5182145 (table test-table [id=19e247824b09424d9ace8f9153937b39]) successfully deleted
I20260923 19:42:32.271889 21641 tablet_service.cc:1467] Processing CreateTablet for tablet d7dc1236d2a843a59e77079fe2ed9f35 (DEFAULT_TABLE table=test-table [id=082782bfc6234c9094a51d1fe3ef15f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:32.272117 21501 tablet_service.cc:1467] Processing CreateTablet for tablet d7dc1236d2a843a59e77079fe2ed9f35 (DEFAULT_TABLE table=test-table [id=082782bfc6234c9094a51d1fe3ef15f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:42:32.272295 21641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7dc1236d2a843a59e77079fe2ed9f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:32.272404 21822 ts_tablet_manager.cc:1939] T e7e40e3de6004da4bf898e9ed5182145 P a2991ce6662a4a2db069ecea6aa39162: Deleting consensus metadata
I20260923 19:42:32.272532 21501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7dc1236d2a843a59e77079fe2ed9f35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:32.273483 21211 catalog_manager.cc:4841] TS a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817): tablet e7e40e3de6004da4bf898e9ed5182145 (table test-table [id=19e247824b09424d9ace8f9153937b39]) successfully deleted
I20260923 19:42:32.277364 21807 tablet_bootstrap.cc:492] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: Bootstrap starting.
I20260923 19:42:32.279008 21807 tablet_bootstrap.cc:654] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:32.279686 21740 tablet_bootstrap.cc:492] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: Bootstrap starting.
I20260923 19:42:32.281195 21740 tablet_bootstrap.cc:654] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:32.270030 21795 ts_tablet_manager.cc:1918] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:42:32.281627 21736 tablet_bootstrap.cc:492] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: Bootstrap starting.
I20260923 19:42:32.281833 21795 log.cc:1196] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/e7e40e3de6004da4bf898e9ed5182145
I20260923 19:42:32.282375 21795 ts_tablet_manager.cc:1939] T e7e40e3de6004da4bf898e9ed5182145 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting consensus metadata
I20260923 19:42:32.283349 21736 tablet_bootstrap.cc:654] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:32.283833 21210 catalog_manager.cc:4841] TS 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263): tablet e7e40e3de6004da4bf898e9ed5182145 (table test-table [id=19e247824b09424d9ace8f9153937b39]) successfully deleted
I20260923 19:42:32.285684 21736 tablet_bootstrap.cc:492] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: No bootstrap required, opened a new log
I20260923 19:42:32.285866 21736 ts_tablet_manager.cc:1397] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:42:32.286824 21736 raft_consensus.cc:348] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.287184 21736 raft_consensus.cc:374] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:32.287276 21736 raft_consensus.cc:729] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d96c23276914ea3a8a51e7c0fc58f97, State: Initialized, Role: FOLLOWER
I20260923 19:42:32.287647 21736 consensus_queue.cc:260] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.289384 21736 ts_tablet_manager.cc:1428] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:32.289922 21807 tablet_bootstrap.cc:492] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: No bootstrap required, opened a new log
I20260923 19:42:32.290122 21807 ts_tablet_manager.cc:1397] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260923 19:42:32.290962 21807 raft_consensus.cc:348] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.291311 21807 raft_consensus.cc:374] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:32.291442 21807 raft_consensus.cc:729] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a40dd9963ceb46d4bc83174e7f5d9357, State: Initialized, Role: FOLLOWER
I20260923 19:42:32.291790 21807 consensus_queue.cc:260] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.292433 21807 ts_tablet_manager.cc:1428] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:42:32.294047 21740 tablet_bootstrap.cc:492] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: No bootstrap required, opened a new log
I20260923 19:42:32.294247 21740 ts_tablet_manager.cc:1397] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.000s
I20260923 19:42:32.294915 21740 raft_consensus.cc:348] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.295241 21740 raft_consensus.cc:374] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:32.295363 21740 raft_consensus.cc:729] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2991ce6662a4a2db069ecea6aa39162, State: Initialized, Role: FOLLOWER
I20260923 19:42:32.295610 21740 consensus_queue.cc:260] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.296756 21740 ts_tablet_manager.cc:1428] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:42:32.610998 21743 raft_consensus.cc:482] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:42:32.611274 21743 raft_consensus.cc:504] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.612789 21743 leader_election.cc:288] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817)
I20260923 19:42:32.621275 21813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.613300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:53999 (local address 127.13.88.194:46817)
0923 19:42:32.613549 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.613559 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.614531 (+ 972us) server_negotiation.cc:407] Connection header received
0923 19:42:32.614619 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.614623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.614711 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.614781 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:32.615424 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.616354 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.618802 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.620086 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.620229 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.620305 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.620870 (+ 565us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.621006 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260923 19:42:32.621335 21827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.613071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:39789 (local address 127.13.88.193:44263)
0923 19:42:32.614193 (+ 1122us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.614198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.614214 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:42:32.614276 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.614280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.614333 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.614413 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:42:32.615051 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.616113 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.618812 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.620087 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.620228 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.620301 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.620882 (+ 581us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.621010 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1022,"thread_start_us":894,"threads_started":1}
I20260923 19:42:32.621685 21828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.613160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:46817 (local address 127.13.88.195:53999)
0923 19:42:32.614407 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:32.614424 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:32.614518 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:32.614852 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:32.614857 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:32.614882 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:32.615281 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.615290 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.616458 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.616467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.618642 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.618656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.620311 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.620317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.620620 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.620718 (+ 98us) client_negotiation.cc:769] Sending connection context
0923 19:42:32.620822 (+ 104us) client_negotiation.cc:240] Negotiation successful
0923 19:42:32.621143 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1130,"mutex_wait_us":241,"thread_start_us":958,"threads_started":1}
I20260923 19:42:32.621718 21826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.613010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44263 (local address 127.13.88.195:39789)
0923 19:42:32.613633 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:32.613665 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:32.613860 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:32.614469 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:32.614476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:32.614504 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:42:32.614855 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.614864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.616246 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.616249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.618642 (+ 2393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.618656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.620316 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.620321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.620636 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.620750 (+ 114us) client_negotiation.cc:769] Sending connection context
0923 19:42:32.620843 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 19:42:32.621143 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":329,"thread_start_us":564,"threads_started":1}
I20260923 19:42:32.622610 21384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7dc1236d2a843a59e77079fe2ed9f35" candidate_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" is_pre_election: true
I20260923 19:42:32.622607 21521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7dc1236d2a843a59e77079fe2ed9f35" candidate_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2991ce6662a4a2db069ecea6aa39162" is_pre_election: true
I20260923 19:42:32.622857 21384 raft_consensus.cc:2454] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a40dd9963ceb46d4bc83174e7f5d9357 in term 0.
I20260923 19:42:32.622869 21521 raft_consensus.cc:2454] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a40dd9963ceb46d4bc83174e7f5d9357 in term 0.
I20260923 19:42:32.623382 21593 leader_election.cc:302] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1d96c23276914ea3a8a51e7c0fc58f97, a2991ce6662a4a2db069ecea6aa39162, a40dd9963ceb46d4bc83174e7f5d9357; no voters:
I20260923 19:42:32.623786 21743 raft_consensus.cc:2781] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:42:32.623915 21743 raft_consensus.cc:482] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:42:32.624012 21743 raft_consensus.cc:3037] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:32.626036 21743 raft_consensus.cc:504] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.626681 21743 leader_election.cc:288] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [CANDIDATE]: Term 1 election: Requested vote from peers 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263), a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817)
I20260923 19:42:32.627152 21384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7dc1236d2a843a59e77079fe2ed9f35" candidate_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d96c23276914ea3a8a51e7c0fc58f97"
I20260923 19:42:32.627190 21521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7dc1236d2a843a59e77079fe2ed9f35" candidate_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2991ce6662a4a2db069ecea6aa39162"
I20260923 19:42:32.627364 21521 raft_consensus.cc:3037] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:32.627382 21384 raft_consensus.cc:3037] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:32.630276 21521 raft_consensus.cc:2454] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a40dd9963ceb46d4bc83174e7f5d9357 in term 1.
I20260923 19:42:32.630308 21384 raft_consensus.cc:2454] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a40dd9963ceb46d4bc83174e7f5d9357 in term 1.
I20260923 19:42:32.630664 21593 leader_election.cc:302] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2991ce6662a4a2db069ecea6aa39162, a40dd9963ceb46d4bc83174e7f5d9357; no voters:
I20260923 19:42:32.630964 21743 raft_consensus.cc:2781] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:32.631377 21743 raft_consensus.cc:686] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 LEADER]: Becoming Leader. State: Replica: a40dd9963ceb46d4bc83174e7f5d9357, State: Running, Role: LEADER
I20260923 19:42:32.631808 21743 consensus_queue.cc:237] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } }
I20260923 19:42:32.635094 21224 catalog_manager.cc:5495] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 reported cstate change: term changed from 0 to 1, leader changed from <none> to a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a40dd9963ceb46d4bc83174e7f5d9357" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37587 } health_report { overall_health: HEALTHY } } }
I20260923 19:42:32.667862 21834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.660604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.13.88.195:37587)
0923 19:42:32.661172 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.661177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.661195 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:42:32.661277 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.661280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.661348 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.661515 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:32.661917 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.662668 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.664405 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.664911 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.665032 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.665898 (+ 866us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:32.666810 (+ 912us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:32.666971 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.667285 (+ 314us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.667410 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":304,"threads_started":1}
I20260923 19:42:32.687964 21827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.681232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:36683 (local address 127.13.88.193:44263)
0923 19:42:32.681545 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.681555 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.682034 (+ 479us) server_negotiation.cc:407] Connection header received
0923 19:42:32.682251 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.682257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.682366 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.682470 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:32.683041 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.684238 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.685595 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.686305 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.686457 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.687049 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:32.687240 (+ 191us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:32.687334 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.687543 (+ 209us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.687630 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260923 19:42:32.688100 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.681242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44263 (local address 127.13.88.195:36683)
0923 19:42:32.681932 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:32.681948 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:32.682109 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:32.682484 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:32.682489 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:32.682500 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:42:32.682832 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.682855 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.684381 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.684388 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.685450 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.685462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.686531 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.686538 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.686755 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.686850 (+ 95us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:42:32.687350 (+ 500us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:42:32.687362 (+ 12us) client_negotiation.cc:769] Sending connection context
0923 19:42:32.687502 (+ 140us) client_negotiation.cc:240] Negotiation successful
0923 19:42:32.687660 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":323,"threads_started":1}
I20260923 19:42:32.696650 21521 raft_consensus.cc:1261] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Refusing update from remote peer a40dd9963ceb46d4bc83174e7f5d9357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:32.696691 21384 raft_consensus.cc:1261] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Refusing update from remote peer a40dd9963ceb46d4bc83174e7f5d9357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:42:32.697306 21829 consensus_queue.cc:1035] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d96c23276914ea3a8a51e7c0fc58f97" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:32.697703 21743 consensus_queue.cc:1035] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2991ce6662a4a2db069ecea6aa39162" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 46817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:42:32.723321 21834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.718092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:38247 (local address 127.13.88.195:37587)
0923 19:42:32.718260 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.718269 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.718916 (+ 647us) server_negotiation.cc:407] Connection header received
0923 19:42:32.719075 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.719078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.719210 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.719284 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:42:32.719628 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.720478 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.722004 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.722412 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.722497 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.722797 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:42:32.722882 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:42:32.722941 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.723027 (+ 86us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.723085 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 19:42:32.723438 21842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.718120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37587 (local address 127.13.88.193:38247)
0923 19:42:32.718810 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:32.718828 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:32.718961 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:32.719310 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:32.719313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:32.719322 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 19:42:32.719513 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.719519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.720609 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.720615 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.721870 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:32.721884 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.722529 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.722533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:32.722637 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.722669 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 19:42:32.722956 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 19:42:32.722963 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 19:42:32.723015 (+ 52us) client_negotiation.cc:240] Negotiation successful
0923 19:42:32.723134 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":373,"threads_started":1}
I20260923 19:42:32.754045 21224 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:32.754335 21224 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:42:32.757558 21224 catalog_manager.cc:5782] T 00000000000000000000000000000000 P feb4a16a797442a89dc56bb92c36094e: Sending DeleteTablet for 3 replicas of tablet d7dc1236d2a843a59e77079fe2ed9f35
I20260923 19:42:32.758430 21362 tablet_service.cc:1514] Processing DeleteTablet for tablet d7dc1236d2a843a59e77079fe2ed9f35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:32 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:42638
I20260923 19:42:32.758810 21795 tablet_replica.cc:330] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: stopping tablet replica
I20260923 19:42:32.759054 21795 raft_consensus.cc:2229] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:32.759312 21795 raft_consensus.cc:2258] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:32.759610 21641 tablet_service.cc:1514] Processing DeleteTablet for tablet d7dc1236d2a843a59e77079fe2ed9f35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:32 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34540
I20260923 19:42:32.759894 21821 tablet_replica.cc:330] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: stopping tablet replica
I20260923 19:42:32.760113 21821 raft_consensus.cc:2229] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:42:32.760351 21501 tablet_service.cc:1514] Processing DeleteTablet for tablet d7dc1236d2a843a59e77079fe2ed9f35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:42:32 UTC) from {username='oryx', principal='oryx/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34998
I20260923 19:42:32.760608 21822 tablet_replica.cc:330] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: stopping tablet replica
I20260923 19:42:32.760634 21821 raft_consensus.cc:2258] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:32.760797 21822 raft_consensus.cc:2229] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:42:32.760975 21822 raft_consensus.cc:2258] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:42:32.761620 21795 ts_tablet_manager.cc:1905] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:32.761715 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 21297
I20260923 19:42:32.762519 21822 ts_tablet_manager.cc:1905] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:32.766681 21821 ts_tablet_manager.cc:1905] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:42:32.769068 21822 ts_tablet_manager.cc:1918] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:42:32.769207 21822 log.cc:1196] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/d7dc1236d2a843a59e77079fe2ed9f35
I20260923 19:42:32.769591 21822 ts_tablet_manager.cc:1939] T d7dc1236d2a843a59e77079fe2ed9f35 P a2991ce6662a4a2db069ecea6aa39162: Deleting consensus metadata
I20260923 19:42:32.775089 21821 ts_tablet_manager.cc:1918] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:42:32.775261 21821 log.cc:1196] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/d7dc1236d2a843a59e77079fe2ed9f35
I20260923 19:42:32.775713 21821 ts_tablet_manager.cc:1939] T d7dc1236d2a843a59e77079fe2ed9f35 P a40dd9963ceb46d4bc83174e7f5d9357: Deleting consensus metadata
I20260923 19:42:32.779248 21795 ts_tablet_manager.cc:1918] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 19:42:32.779493 21795 log.cc:1196] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/d7dc1236d2a843a59e77079fe2ed9f35
I20260923 19:42:32.779966 21795 ts_tablet_manager.cc:1939] T d7dc1236d2a843a59e77079fe2ed9f35 P 1d96c23276914ea3a8a51e7c0fc58f97: Deleting consensus metadata
I20260923 19:42:32.781003 21210 catalog_manager.cc:4841] TS 1d96c23276914ea3a8a51e7c0fc58f97 (127.13.88.193:44263): tablet d7dc1236d2a843a59e77079fe2ed9f35 (table test-table [id=082782bfc6234c9094a51d1fe3ef15f4]) successfully deleted
I20260923 19:42:32.781436 21213 catalog_manager.cc:4841] TS a40dd9963ceb46d4bc83174e7f5d9357 (127.13.88.195:37587): tablet d7dc1236d2a843a59e77079fe2ed9f35 (table test-table [id=082782bfc6234c9094a51d1fe3ef15f4]) successfully deleted
I20260923 19:42:32.787648 21211 catalog_manager.cc:4841] TS a2991ce6662a4a2db069ecea6aa39162 (127.13.88.194:46817): tablet d7dc1236d2a843a59e77079fe2ed9f35 (table test-table [id=082782bfc6234c9094a51d1fe3ef15f4]) successfully deleted
Sep 23 19:42:32 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.193@KRBTEST.COM
I20260923 19:42:32.801640 21827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.776491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50078 (local address 127.13.88.193:44263)
0923 19:42:32.776685 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.776692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.781860 (+ 5168us) server_negotiation.cc:407] Connection header received
0923 19:42:32.782140 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.782145 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.782235 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.782317 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:32.784194 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.785375 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.787265 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.787904 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.788004 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.793889 (+ 5885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:32.793909 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:32.793930 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:32.793976 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:32.798096 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:32.798944 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:32.798953 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:32.798957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:32.799174 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:32.799644 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:32.799649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:32.799652 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:32.800125 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:32.800413 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.800996 (+ 583us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.801224 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:42:32.803030 21428 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:32.937310 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 21297
I20260923 19:42:32.960799 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 21437
Sep 23 19:42:32 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.194@KRBTEST.COM
I20260923 19:42:32.977821 21813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:32.961568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56274 (local address 127.13.88.194:46817)
0923 19:42:32.961747 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:32.961751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:32.961798 (+ 47us) server_negotiation.cc:407] Connection header received
0923 19:42:32.962022 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:32.962027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:32.962089 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:32.962169 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:32.963794 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.964490 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.966193 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:32.966649 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:32.966780 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:32.971949 (+ 5169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:32.971962 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:32.971979 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:32.972081 (+ 102us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:32.974994 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:32.975835 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:32.975845 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:32.975848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:32.976007 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:32.976384 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:32.976387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:32.976389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:32.976784 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:32.977026 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:32.977330 (+ 304us) server_negotiation.cc:299] Negotiation successful
0923 19:42:32.977512 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:42:32.978559 21567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:33.109714 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 21437
I20260923 19:42:33.132699 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 21576
Sep 23 19:42:33 dist-test-slave-xg7f krb5kdc[21181](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.13.88.195@KRBTEST.COM
I20260923 19:42:33.151243 21834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:33.133538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59172 (local address 127.13.88.195:37587)
0923 19:42:33.133718 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:33.133722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:33.133887 (+ 165us) server_negotiation.cc:407] Connection header received
0923 19:42:33.134078 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:33.134082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:33.134141 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:33.134227 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:33.135943 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:33.136701 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:33.138560 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:33.139250 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:33.139406 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:33.145039 (+ 5633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:33.145055 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:33.145075 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:33.145117 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:33.148455 (+ 3338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:33.149163 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:33.149179 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:33.149181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:33.149307 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:33.149686 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:33.149691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:33.149701 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:33.150063 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:33.150434 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:33.150632 (+ 198us) server_negotiation.cc:299] Negotiation successful
0923 19:42:33.150873 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 19:42:33.152091 21703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:33.300798 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 21576
I20260923 19:42:33.322503 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 21194
I20260923 19:42:33.323696 21266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:33.436744 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 21194
2026-09-23T19:42:33Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6975 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:42:33 dist-test-slave-xg7f krb5kdc[21852](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:42:33 dist-test-slave-xg7f krb5kdc[21852](info): set up 2 sockets
Sep 23 19:42:33 dist-test-slave-xg7f krb5kdc[21852](info): commencing operation
krb5kdc: starting...
W20260923 19:42:34.524055 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.005s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:42:34 dist-test-slave-xg7f krb5kdc[21852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:42:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:42:34.734179 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:34819
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:34819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:35.051184 21865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:35.051483 21865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:35.051638 21865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:35.058928 21865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:35.059038 21865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:35.059150 21865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:35.059253 21865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:35.059340 21865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:35.069087 21865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:34819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:34819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:35.070407 21865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:35.071753 21865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:35.083166 21873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:35.083348 21871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:35.083323 21870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:35.084358 21865 server_base.cc:1034] running on GCE node
I20260923 19:42:35.085090 21865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:35.086465 21865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:35.087702 21865 hybrid_clock.cc:648] HybridClock initialized: now 1790192555087643 us; error 40 us; skew 500 ppm
I20260923 19:42:35.088034 21865 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-23T19:42:35Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1724 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:42:35 dist-test-slave-xg7f krb5kdc[21879](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:42:35 dist-test-slave-xg7f krb5kdc[21879](info): set up 2 sockets
Sep 23 19:42:35 dist-test-slave-xg7f krb5kdc[21879](info): commencing operation
krb5kdc: starting...
W20260923 19:42:36.240221 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:42:36 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:42:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:42:36.450922 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:44965
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:44965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:36.774953 21892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:36.775343 21892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:36.775439 21892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:36.782529 21892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:36.782624 21892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:36.782670 21892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:36.782717 21892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:36.782752 21892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:36.792588 21892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:44965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:44965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:36.793913 21892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:36.795219 21892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:36.806835 21897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:36.806859 21898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:36.806897 21900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:36.807612 21892 server_base.cc:1034] running on GCE node
I20260923 19:42:36.808410 21892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:36.809779 21892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:36.810994 21892 hybrid_clock.cc:648] HybridClock initialized: now 1790192556810951 us; error 29 us; skew 500 ppm
I20260923 19:42:36.811370 21892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:36 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192556, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:36.814308 21892 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:42:36.815857 21892 webserver.cc:460] Webserver started at http://127.13.88.254:45795/ using document root <none> and password file <none>
I20260923 19:42:36.816545 21892 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:36.816687 21892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:36.817000 21892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:36.820112 21892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "255de14ae4a348bead1dfb68df58b633"
format_stamp: "Formatted at 2026-09-23 19:42:36 on dist-test-slave-xg7f"
server_key: "8bba6c795bf3490666c577bae42def44"
server_key_iv: "27ddcb744a5b515033e6790b963cc278"
server_key_version: "encryptionkey@0"
I20260923 19:42:36.820904 21892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "255de14ae4a348bead1dfb68df58b633"
format_stamp: "Formatted at 2026-09-23 19:42:36 on dist-test-slave-xg7f"
server_key: "8bba6c795bf3490666c577bae42def44"
server_key_iv: "27ddcb744a5b515033e6790b963cc278"
server_key_version: "encryptionkey@0"
I20260923 19:42:36.826120 21892 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:42:36.829582 21907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:36.830956 21892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:36.831193 21892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "255de14ae4a348bead1dfb68df58b633"
format_stamp: "Formatted at 2026-09-23 19:42:36 on dist-test-slave-xg7f"
server_key: "8bba6c795bf3490666c577bae42def44"
server_key_iv: "27ddcb744a5b515033e6790b963cc278"
server_key_version: "encryptionkey@0"
I20260923 19:42:36.831399 21892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:36.865885 21892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:36.870289 21892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:36.870596 21892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:36.889344 21892 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:44965
I20260923 19:42:36.889364 21958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:44965 every 8 connection(s)
I20260923 19:42:36.890734 21892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:36.891508 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 21892
I20260923 19:42:36.891742 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:36.892508 13667 external_mini_cluster.cc:1428] Setting key a190465371d9632c4cef5d90ce07c56e
I20260923 19:42:36.895234 21959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:42:36 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:36.908089 21959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Bootstrap starting.
I20260923 19:42:36.911212 21959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:36.912230 21959 log.cc:824] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:36.915063 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:36.894573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43290 (local address 127.13.88.254:44965)
0923 19:42:36.895451 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:36.895462 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:36.895502 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:42:36.897080 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:36.897102 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:36.897467 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:36.897815 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:36.899576 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:36.900918 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:36.902657 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:36.903318 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:36.903442 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:36.907957 (+ 4515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:36.907965 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:36.907979 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:36.908018 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:36.910993 (+ 2975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:36.911771 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:36.911778 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:36.911785 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:36.911955 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:36.912353 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:36.912376 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:36.912380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:36.912918 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:36.913280 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:36.913729 (+ 449us) server_negotiation.cc:299] Negotiation successful
0923 19:42:36.914149 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":379,"threads_started":1}
I20260923 19:42:36.915194 21959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: No bootstrap required, opened a new log
I20260923 19:42:36.923677 21959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:36.924062 21959 raft_consensus.cc:374] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:36.924168 21959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255de14ae4a348bead1dfb68df58b633, State: Initialized, Role: FOLLOWER
I20260923 19:42:36.924686 21959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:36.924969 21959 raft_consensus.cc:388] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:36.925136 21959 raft_consensus.cc:482] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:36.925328 21959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:36.927541 21959 raft_consensus.cc:504] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:36.928021 21959 leader_election.cc:302] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 255de14ae4a348bead1dfb68df58b633; no voters:
I20260923 19:42:36.928568 21959 leader_election.cc:288] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:36.928691 21964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:36.929343 21964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 LEADER]: Becoming Leader. State: Replica: 255de14ae4a348bead1dfb68df58b633, State: Running, Role: LEADER
I20260923 19:42:36.929881 21964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:36.930644 21959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:36.932796 21965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "255de14ae4a348bead1dfb68df58b633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } } }
I20260923 19:42:36.932786 21966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 255de14ae4a348bead1dfb68df58b633. Latest consensus state: current_term: 1 leader_uuid: "255de14ae4a348bead1dfb68df58b633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } } }
I20260923 19:42:36.933342 21965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:36.933449 21966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:36.934297 21972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:36.940447 21972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:36.949637 21972 catalog_manager.cc:1347] Generated new cluster ID: 4194b8430f644269a79ea78988dc10d2
I20260923 19:42:36.949826 21972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:36.963709 21972 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:36.965087 21972 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:36.974303 21972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Generated new TSK 0
I20260923 19:42:36.975251 21972 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:42:37.040825 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:44965
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:37.385586 21985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:37.385941 21985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:37.386123 21985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:37.393368 21985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:37.393532 21985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:37.393735 21985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:37.403751 21985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:44965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:37.405129 21985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:37.406466 21985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:37.419554 21991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:37.419586 21993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:37.420102 21985 server_base.cc:1034] running on GCE node
W20260923 19:42:37.420255 21990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:37.421030 21985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:37.421964 21985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:37.423210 21985 hybrid_clock.cc:648] HybridClock initialized: now 1790192557423148 us; error 49 us; skew 500 ppm
I20260923 19:42:37.423524 21985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:37 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192557, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:37.426573 21985 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:42:37.428068 21985 webserver.cc:460] Webserver started at http://127.13.88.193:44025/ using document root <none> and password file <none>
I20260923 19:42:37.428750 21985 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:37.428889 21985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:37.429195 21985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:37.432250 21985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "eb851c7c28c04dbcb45272ee626c23a4"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "461bb067e520379591d463a9d23ac4d6"
server_key_iv: "c9792806bf0c00c00d309de4cacd2fcb"
server_key_version: "encryptionkey@0"
I20260923 19:42:37.433003 21985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "eb851c7c28c04dbcb45272ee626c23a4"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "461bb067e520379591d463a9d23ac4d6"
server_key_iv: "c9792806bf0c00c00d309de4cacd2fcb"
server_key_version: "encryptionkey@0"
I20260923 19:42:37.438395 21985 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:42:37.441722 22000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:37.443029 21985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:37.443250 21985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "eb851c7c28c04dbcb45272ee626c23a4"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "461bb067e520379591d463a9d23ac4d6"
server_key_iv: "c9792806bf0c00c00d309de4cacd2fcb"
server_key_version: "encryptionkey@0"
I20260923 19:42:37.443459 21985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:37.454502 21985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:37.458711 21985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:37.459007 21985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:37.459945 21985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:37.461162 21985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:37.461256 21985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:37.461388 21985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:37.461454 21985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:37.494577 21985 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:46653
I20260923 19:42:37.494616 22112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:46653 every 8 connection(s)
I20260923 19:42:37.495887 21985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:37.505769 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 21985
I20260923 19:42:37.505968 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:37.506764 13667 external_mini_cluster.cc:1428] Setting key 6c319a4dcf0a1dbfbbfe4983f810eefc
Sep 23 19:42:37 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192557, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:37.516703 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:37.498440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:55699 (local address 127.13.88.254:44965)
0923 19:42:37.498865 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:37.498869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:37.499882 (+ 1013us) server_negotiation.cc:407] Connection header received
0923 19:42:37.501659 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:37.501663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:37.501740 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:37.501860 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:37.503352 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:37.504125 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:37.505635 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:37.506297 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:37.506436 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:37.510006 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:37.510015 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:37.510024 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:37.510071 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:37.513605 (+ 3534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:37.514326 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:37.514335 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:37.514341 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:37.514492 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:37.514896 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:37.514903 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:37.514909 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:37.515327 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:37.515484 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:37.516285 (+ 801us) server_negotiation.cc:299] Negotiation successful
0923 19:42:37.516447 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":213,"threads_started":1}
I20260923 19:42:37.518221 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:37.499002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:55699)
0923 19:42:37.499721 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:37.499763 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:37.501384 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:37.502075 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:37.502083 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:37.502567 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:37.503203 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:37.503223 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:37.504261 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:37.504264 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:37.505490 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:37.505505 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:37.506504 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:37.506509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:37.506703 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:37.507500 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:37.507522 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:37.509782 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:37.513756 (+ 3974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:37.513763 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:37.513777 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:37.514188 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:37.514597 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:37.514600 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:37.514602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:37.514781 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:37.515454 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:37.515460 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:37.515828 (+ 368us) client_negotiation.cc:769] Sending connection context
0923 19:42:37.516169 (+ 341us) client_negotiation.cc:240] Negotiation successful
0923 19:42:37.516769 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":260,"threads_started":1}
I20260923 19:42:37.519858 22113 heartbeater.cc:347] Connected to a master server at 127.13.88.254:44965
I20260923 19:42:37.520172 22113 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:37.520876 22113 heartbeater.cc:511] Master 127.13.88.254:44965 requested a full tablet report, sending...
I20260923 19:42:37.523051 21924 ts_manager.cc:194] Registered new tserver with Master: eb851c7c28c04dbcb45272ee626c23a4 (127.13.88.193:46653)
I20260923 19:42:37.525259 21924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:55699
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:42:37.556568 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:44965
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:37.877486 22119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:37.877797 22119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:37.877969 22119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:37.885252 22119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:37.885385 22119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:37.885571 22119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:37.899760 22119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:44965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:37.901309 22119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:37.902909 22119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:37.917605 22124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:37.917589 22125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:37.917760 22127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:37.918469 22119 server_base.cc:1034] running on GCE node
I20260923 19:42:37.919185 22119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:37.920168 22119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:37.921398 22119 hybrid_clock.cc:648] HybridClock initialized: now 1790192557921339 us; error 45 us; skew 500 ppm
I20260923 19:42:37.921764 22119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:37 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192557, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:37.924989 22119 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:42:37.926473 22119 webserver.cc:460] Webserver started at http://127.13.88.194:42761/ using document root <none> and password file <none>
I20260923 19:42:37.927299 22119 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:37.927429 22119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:37.927747 22119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:37.930557 22119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "ecad16f74f644cbb996c09a8efc1df23"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "abccbc955cb49d920b75ae9d39aa390a"
server_key_iv: "5236b7dcf8a1afdb58cc26f3fc9d01d8"
server_key_version: "encryptionkey@0"
I20260923 19:42:37.931406 22119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "ecad16f74f644cbb996c09a8efc1df23"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "abccbc955cb49d920b75ae9d39aa390a"
server_key_iv: "5236b7dcf8a1afdb58cc26f3fc9d01d8"
server_key_version: "encryptionkey@0"
I20260923 19:42:37.936794 22119 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:42:37.940353 22134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:37.941895 22119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:37.942073 22119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "ecad16f74f644cbb996c09a8efc1df23"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "abccbc955cb49d920b75ae9d39aa390a"
server_key_iv: "5236b7dcf8a1afdb58cc26f3fc9d01d8"
server_key_version: "encryptionkey@0"
I20260923 19:42:37.942281 22119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:37.956305 22119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:37.960130 22119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:37.960497 22119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:37.961375 22119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:37.962561 22119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:37.962630 22119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:37.962707 22119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:37.962752 22119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:37.995934 22119 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:34079
I20260923 19:42:37.996022 22246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:34079 every 8 connection(s)
I20260923 19:42:37.997267 22119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:37.998497 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 22119
I20260923 19:42:37.998700 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:37.999567 13667 external_mini_cluster.cc:1428] Setting key 81e696bf769eb7b8215f84b713801320
Sep 23 19:42:38 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192557, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:38.022869 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:38.001455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:48435 (local address 127.13.88.254:44965)
0923 19:42:38.001627 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:38.001633 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:38.001893 (+ 260us) server_negotiation.cc:407] Connection header received
0923 19:42:38.003804 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:38.003809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:38.003894 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:38.003950 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:38.005806 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.006787 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.009089 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.009740 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.009831 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:38.014908 (+ 5077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:38.014917 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:38.014924 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:38.014974 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:38.018875 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.019936 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.019944 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.019948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.020118 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.020655 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.020662 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.020667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.021058 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:38.021215 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:38.022259 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0923 19:42:38.022505 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:42:38.025580 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:38.000859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:48435)
0923 19:42:38.001750 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:38.001791 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:38.003445 (+ 1654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:38.004404 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:38.004412 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:38.004920 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:38.005623 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:38.005644 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.006960 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.006967 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:38.008929 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:38.008945 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.010126 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.010133 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:38.010436 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:38.011266 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:38.011302 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:38.014571 (+ 3269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:38.019041 (+ 4470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:38.019054 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:38.019077 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:38.019788 (+ 711us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:38.020243 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:38.020250 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:38.020256 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:38.020520 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:38.021218 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:38.021230 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:38.021759 (+ 529us) client_negotiation.cc:769] Sending connection context
0923 19:42:38.023473 (+ 1714us) client_negotiation.cc:240] Negotiation successful
0923 19:42:38.024079 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":345,"threads_started":1}
I20260923 19:42:38.027424 22247 heartbeater.cc:347] Connected to a master server at 127.13.88.254:44965
I20260923 19:42:38.027778 22247 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:38.028813 22247 heartbeater.cc:511] Master 127.13.88.254:44965 requested a full tablet report, sending...
I20260923 19:42:38.030576 21924 ts_manager.cc:194] Registered new tserver with Master: ecad16f74f644cbb996c09a8efc1df23 (127.13.88.194:34079)
I20260923 19:42:38.031723 21924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:48435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:42:38.060205 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:44965
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:38.382684 22252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:38.382952 22252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:38.383052 22252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:38.390036 22252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:38.390138 22252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:38.390245 22252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:38.400010 22252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:44965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:38.401250 22252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:38.402505 22252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:38.415624 22258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:38.415650 22257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:38.415936 22260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:38.416507 22252 server_base.cc:1034] running on GCE node
I20260923 19:42:38.417166 22252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:38.418123 22252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:38.419339 22252 hybrid_clock.cc:648] HybridClock initialized: now 1790192558419280 us; error 62 us; skew 500 ppm
I20260923 19:42:38.419718 22252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:38 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192558, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:38.422768 22252 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:42:38.424250 22252 webserver.cc:460] Webserver started at http://127.13.88.195:45355/ using document root <none> and password file <none>
I20260923 19:42:38.424921 22252 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:38.425014 22252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:38.425264 22252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:38.428164 22252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "3dd1aba7c72a491aa0cc5c3e5d93ac74"
format_stamp: "Formatted at 2026-09-23 19:42:38 on dist-test-slave-xg7f"
server_key: "447e3798f7ac1bcfd5888446af42081a"
server_key_iv: "7eea5803fe50fc28a1486421cac62263"
server_key_version: "encryptionkey@0"
I20260923 19:42:38.428895 22252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "3dd1aba7c72a491aa0cc5c3e5d93ac74"
format_stamp: "Formatted at 2026-09-23 19:42:38 on dist-test-slave-xg7f"
server_key: "447e3798f7ac1bcfd5888446af42081a"
server_key_iv: "7eea5803fe50fc28a1486421cac62263"
server_key_version: "encryptionkey@0"
I20260923 19:42:38.434067 22252 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:42:38.437654 22267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:38.438956 22252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:42:38.439147 22252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "3dd1aba7c72a491aa0cc5c3e5d93ac74"
format_stamp: "Formatted at 2026-09-23 19:42:38 on dist-test-slave-xg7f"
server_key: "447e3798f7ac1bcfd5888446af42081a"
server_key_iv: "7eea5803fe50fc28a1486421cac62263"
server_key_version: "encryptionkey@0"
I20260923 19:42:38.439360 22252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:38.456070 22252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:38.459777 22252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:38.460018 22252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:38.460933 22252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:38.462154 22252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:38.462224 22252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:38.462302 22252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:38.462343 22252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:38.495028 22252 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:38261
I20260923 19:42:38.495047 22379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:38261 every 8 connection(s)
I20260923 19:42:38.496626 22252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:38.501191 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 22252
I20260923 19:42:38.501379 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:38.501806 13667 external_mini_cluster.cc:1428] Setting key 6e541db2dd8631e5ffa2ae6c85682230
Sep 23 19:42:38 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192558, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:42:38.516626 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:38.499231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:48011 (local address 127.13.88.254:44965)
0923 19:42:38.499433 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:38.499439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:38.500673 (+ 1234us) server_negotiation.cc:407] Connection header received
0923 19:42:38.502719 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:38.502724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:38.502839 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:38.502931 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:38.504946 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.505729 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.507246 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.507640 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.507731 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:38.511258 (+ 3527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:38.511263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:38.511266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:38.511297 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:38.513651 (+ 2354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.514289 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.514293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.514295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.514416 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.514782 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.514785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.514787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.515030 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:38.515200 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:38.515981 (+ 781us) server_negotiation.cc:299] Negotiation successful
0923 19:42:38.516212 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:42:38.517715 22382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:38.499677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:48011)
0923 19:42:38.500481 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:38.500532 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:38.502440 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:38.503260 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:38.503270 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:38.503925 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:38.504736 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:38.504772 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.505876 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.505879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:38.507073 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:38.507084 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.507827 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.507832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:38.508033 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:38.508710 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:38.508733 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:38.511006 (+ 2273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:38.513776 (+ 2770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:38.513783 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:38.513796 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:38.514188 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:38.514505 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:42:38.514508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:42:38.514511 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:42:38.514684 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:42:38.515193 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:38.515199 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:38.515576 (+ 377us) client_negotiation.cc:769] Sending connection context
0923 19:42:38.515854 (+ 278us) client_negotiation.cc:240] Negotiation successful
0923 19:42:38.516405 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":338,"threads_started":1}
I20260923 19:42:38.518997 22380 heartbeater.cc:347] Connected to a master server at 127.13.88.254:44965
I20260923 19:42:38.519315 22380 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:38.519999 22380 heartbeater.cc:511] Master 127.13.88.254:44965 requested a full tablet report, sending...
I20260923 19:42:38.521317 21924 ts_manager.cc:194] Registered new tserver with Master: 3dd1aba7c72a491aa0cc5c3e5d93ac74 (127.13.88.195:38261)
I20260923 19:42:38.522099 21924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:48011
I20260923 19:42:38.528437 22113 heartbeater.cc:503] Master 127.13.88.254:44965 was elected leader, sending a full tablet report...
I20260923 19:42:38.530117 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab.
Entry for principal oryx/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab.
WARNING: no policy specified for oryx/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab.
Entry for principal oryx/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab.
WARNING: no policy specified for oryx/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab.
Entry for principal oryx/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab.
I20260923 19:42:38.666062 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 21985
Sep 23 19:42:38 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:42:38.683146 22390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:38.667289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50016 (local address 127.13.88.193:46653)
0923 19:42:38.668010 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:38.668019 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:38.668051 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:42:38.668110 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:38.668116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:38.668342 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:38.668514 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:38.669860 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.670942 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.672288 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.672856 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.672997 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:38.677349 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:38.677361 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:38.677377 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:38.677419 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:38.680152 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.680935 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.680942 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.680957 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.681088 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.681473 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.681478 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.681480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.681827 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:38.682127 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:38.682443 (+ 316us) server_negotiation.cc:299] Negotiation successful
0923 19:42:38.682717 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":335,"threads_started":1}
I20260923 19:42:38.684459 22108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:38.768314 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 21985
I20260923 19:42:38.784075 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22119
Sep 23 19:42:38 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:42:38.798987 22392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:38.784979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52592 (local address 127.13.88.194:34079)
0923 19:42:38.785504 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:38.785511 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:38.785536 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:42:38.785595 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:38.785601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:38.785818 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:38.785940 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:38.787033 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.788080 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.789331 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.789851 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.789950 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:38.793839 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:38.793851 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:38.793865 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:38.793895 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:38.796609 (+ 2714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.797193 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.797199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.797201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.797320 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.797602 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.797605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.797607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.797930 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:38.798172 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:38.798502 (+ 330us) server_negotiation.cc:299] Negotiation successful
0923 19:42:38.798689 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":269,"threads_started":1}
I20260923 19:42:38.800274 22242 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:38.881955 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 22119
I20260923 19:42:38.897773 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22252
Sep 23 19:42:38 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:42:38.914070 22394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:38.898794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46926 (local address 127.13.88.195:38261)
0923 19:42:38.899502 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:38.899509 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:38.899542 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:42:38.899602 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:38.899609 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:38.899819 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:38.899997 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:38.901348 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.902339 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.903734 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:38.904295 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:38.904440 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:38.908710 (+ 4270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:38.908721 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:38.908736 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:38.908772 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:38.911318 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.911998 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.912006 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.912008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.912136 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:38.912511 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:38.912517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:38.912520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:38.912876 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:38.913183 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:38.913440 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 19:42:38.913721 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":398,"threads_started":1}
I20260923 19:42:38.915431 22375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:38.996505 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 22252
I20260923 19:42:39.012209 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 21892
I20260923 19:42:39.013357 21954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:39.115551 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 21892
I20260923 19:42:39.136878 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:44965
--webserver_interface=127.13.88.254
--webserver_port=45795
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:44965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:42:39.468806 22397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:39.469089 22397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:39.469259 22397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:39.476542 22397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:39.476639 22397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:39.476682 22397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:39.476778 22397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:39.476864 22397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:39.486009 22397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:44965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:44965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=45795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:39.487332 22397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:39.488618 22397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:39.500142 22402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:39.500232 22405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:39.500258 22403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:39.501065 22397 server_base.cc:1034] running on GCE node
I20260923 19:42:39.501837 22397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:39.503259 22397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:39.504482 22397 hybrid_clock.cc:648] HybridClock initialized: now 1790192559504432 us; error 51 us; skew 500 ppm
I20260923 19:42:39.504817 22397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:39 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192559, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:39.507930 22397 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:42:39.509387 22397 webserver.cc:460] Webserver started at http://127.13.88.254:45795/ using document root <none> and password file <none>
I20260923 19:42:39.510113 22397 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:39.510265 22397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:39.515749 22397 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:42:39.518450 22412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:39.519816 22397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:39.519994 22397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "255de14ae4a348bead1dfb68df58b633"
format_stamp: "Formatted at 2026-09-23 19:42:36 on dist-test-slave-xg7f"
server_key: "8bba6c795bf3490666c577bae42def44"
server_key_iv: "27ddcb744a5b515033e6790b963cc278"
server_key_version: "encryptionkey@0"
I20260923 19:42:39.520952 22397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:39.540298 22397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:39.544682 22397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:39.544952 22397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:39.562979 22397 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:44965
I20260923 19:42:39.562997 22463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:44965 every 8 connection(s)
I20260923 19:42:39.564512 22397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:39.571385 22464 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:42:39.574680 22464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Bootstrap starting.
I20260923 19:42:39.575078 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 22397
I20260923 19:42:39.575924 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:46653
--local_ip_for_outbound_sockets=127.13.88.193
--tserver_master_addrs=127.13.88.254:44965
--webserver_port=44025
--webserver_interface=127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:42:39.598603 22464 log.cc:824] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:39.607708 22464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:42:39.608228 22464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Bootstrap complete.
I20260923 19:42:39.617226 22464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:39.618045 22464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255de14ae4a348bead1dfb68df58b633, State: Initialized, Role: FOLLOWER
I20260923 19:42:39.618690 22464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:39.618923 22464 raft_consensus.cc:388] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:39.619036 22464 raft_consensus.cc:482] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:39.619242 22464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:42:39.622736 22464 raft_consensus.cc:504] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:39.623252 22464 leader_election.cc:302] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 255de14ae4a348bead1dfb68df58b633; no voters:
I20260923 19:42:39.623899 22464 leader_election.cc:288] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:42:39.624085 22468 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:42:39.625063 22468 raft_consensus.cc:686] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [term 2 LEADER]: Becoming Leader. State: Replica: 255de14ae4a348bead1dfb68df58b633, State: Running, Role: LEADER
I20260923 19:42:39.625880 22464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:39.625831 22468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } }
I20260923 19:42:39.632453 22469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "255de14ae4a348bead1dfb68df58b633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } } }
I20260923 19:42:39.632915 22469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:39.633481 22470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 255de14ae4a348bead1dfb68df58b633. Latest consensus state: current_term: 2 leader_uuid: "255de14ae4a348bead1dfb68df58b633" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255de14ae4a348bead1dfb68df58b633" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44965 } } }
I20260923 19:42:39.633769 22470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:39.641111 22479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:39.645809 22479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:39.646808 22479 catalog_manager.cc:1259] Loaded cluster ID: 4194b8430f644269a79ea78988dc10d2
I20260923 19:42:39.646924 22479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:39.649490 22479 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:39.650491 22479 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 255de14ae4a348bead1dfb68df58b633: Loaded TSK: 0
I20260923 19:42:39.651705 22479 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 19:42:39.934830 22466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:39.935180 22466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:39.935343 22466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:39.942572 22466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:39.942714 22466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:39.942893 22466 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:39.952890 22466 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.193.keytab
--principal=oryx/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:46653
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=44025
--tserver_master_addrs=127.13.88.254:44965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:39.954257 22466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:39.955694 22466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:39.970767 22492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:39.971385 22491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:39.971424 22466 server_base.cc:1034] running on GCE node
W20260923 19:42:39.971385 22494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:39.972256 22466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:39.973244 22466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:39.974476 22466 hybrid_clock.cc:648] HybridClock initialized: now 1790192559974415 us; error 48 us; skew 500 ppm
I20260923 19:42:39.974797 22466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:39 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192559, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:39.977842 22466 init.cc:377] Logged in from keytab as oryx/127.13.88.193@KRBTEST.COM (short username oryx)
I20260923 19:42:39.979391 22466 webserver.cc:460] Webserver started at http://127.13.88.193:44025/ using document root <none> and password file <none>
I20260923 19:42:39.980121 22466 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:39.980249 22466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:39.986024 22466 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260923 19:42:39.988794 22501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:39.990243 22466 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:42:39.990402 22466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "eb851c7c28c04dbcb45272ee626c23a4"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "461bb067e520379591d463a9d23ac4d6"
server_key_iv: "c9792806bf0c00c00d309de4cacd2fcb"
server_key_version: "encryptionkey@0"
I20260923 19:42:39.991366 22466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:40.009261 22466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:40.013262 22466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:40.013571 22466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:40.014554 22466 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:40.015884 22466 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:40.016004 22466 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:40.016132 22466 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:40.016222 22466 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:40.048794 22466 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:46653
I20260923 19:42:40.048849 22613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:46653 every 8 connection(s)
I20260923 19:42:40.050222 22466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:40.051537 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 22466
I20260923 19:42:40.052287 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:34079
--local_ip_for_outbound_sockets=127.13.88.194
--tserver_master_addrs=127.13.88.254:44965
--webserver_port=42761
--webserver_interface=127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:42:40 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:40 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:42:40.472023 22618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:40.472344 22618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:40.472503 22618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:40.479410 22618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:40.479552 22618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:40.479718 22618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:40.489238 22618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.194.keytab
--principal=oryx/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:34079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=42761
--tserver_master_addrs=127.13.88.254:44965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:40.490494 22618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:40.491840 22618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:40.508726 22625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:40.508831 22624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:40.510124 22627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:40.510641 22618 server_base.cc:1034] running on GCE node
I20260923 19:42:40.511332 22618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:40.512285 22618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:40.513496 22618 hybrid_clock.cc:648] HybridClock initialized: now 1790192560513455 us; error 35 us; skew 500 ppm
I20260923 19:42:40.513814 22618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:40 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192560, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:40.521807 22618 init.cc:377] Logged in from keytab as oryx/127.13.88.194@KRBTEST.COM (short username oryx)
I20260923 19:42:40.523538 22618 webserver.cc:460] Webserver started at http://127.13.88.194:42761/ using document root <none> and password file <none>
I20260923 19:42:40.524325 22618 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:40.524458 22618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:40.529991 22618 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 19:42:40.532763 22634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:40.534181 22618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:42:40.534341 22618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "ecad16f74f644cbb996c09a8efc1df23"
format_stamp: "Formatted at 2026-09-23 19:42:37 on dist-test-slave-xg7f"
server_key: "abccbc955cb49d920b75ae9d39aa390a"
server_key_iv: "5236b7dcf8a1afdb58cc26f3fc9d01d8"
server_key_version: "encryptionkey@0"
I20260923 19:42:40.535300 22618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:40.551211 22618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:40.555400 22618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:40.555665 22618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:40.556661 22618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:40.558008 22618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:40.558141 22618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:40.558259 22618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:40.558333 22618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:40.624558 22618 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:34079
I20260923 19:42:40.624622 22746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:34079 every 8 connection(s)
I20260923 19:42:40.626124 22618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:40.629467 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 22618
I20260923 19:42:40.630203 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:38261
--local_ip_for_outbound_sockets=127.13.88.195
--tserver_master_addrs=127.13.88.254:44965
--webserver_port=45355
--webserver_interface=127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:42:40 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:40 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:42:41.272439 22751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:41.272864 22751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:41.273015 22751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:41.284749 22751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:41.284897 22751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:41.285084 22751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:41.301093 22751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/krb5kdc/oryx_127.13.88.195.keytab
--principal=oryx/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:38261
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=45355
--tserver_master_addrs=127.13.88.254:44965
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:41.302752 22751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:41.304427 22751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:41.317791 22617 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.250s user 0.003s sys 0.010s
I20260923 19:42:41.320348 22617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:40.053517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:32923)
0923 19:42:40.055681 (+ 2164us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:40.055731 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:40.058518 (+ 2787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:40.060258 (+ 1740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:40.060265 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:40.060741 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:40.061271 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:40.061288 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.063627 (+ 2339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.063631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:40.064843 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:40.064855 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.066321 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.066325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:40.066534 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:40.067253 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:40.067278 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:41.318902 (+1251624us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1872,"thread_start_us":1664,"threads_started":1}
W20260923 19:42:41.321630 22614 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:44965 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.88.254:44965: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
W20260923 19:42:41.323141 22616 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:40.053499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:32923 (local address 127.13.88.254:44965)
0923 19:42:40.054270 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:40.054287 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:40.055866 (+ 1579us) server_negotiation.cc:407] Connection header received
0923 19:42:40.059213 (+ 3347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:40.059234 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:40.059732 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:40.060162 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:40.061459 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.063481 (+ 2022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.064984 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.066108 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.066333 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.321941 (+1255608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:32923: BlockingRecv error: recv got EOF from 127.13.88.193:32923 (error 108)
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":271,"threads_started":1}
W20260923 19:42:41.335606 22757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:42:41.336831 22758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:42:41.340436 22616 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:41.322784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:53341 (local address 127.13.88.254:44965)
0923 19:42:41.323635 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:41.323645 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:41.324568 (+ 923us) server_negotiation.cc:407] Connection header received
0923 19:42:41.324655 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:41.324663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:41.324765 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:41.324877 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:41.326332 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.327885 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.330497 (+ 2612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.331389 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.331511 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.340239 (+ 8728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:53341: BlockingRecv error: recv got EOF from 127.13.88.193:53341 (error 108)
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":14829,"threads_started":1}
I20260923 19:42:41.340559 22617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:41.322733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:53341)
0923 19:42:41.324211 (+ 1478us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:41.324247 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:41.324423 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:41.325140 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:41.325147 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:41.325798 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:41.326093 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.326107 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.328143 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.328151 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.330289 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.330307 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.331913 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.331921 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.332173 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.334021 (+ 1848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:41.334055 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:41.340070 (+ 6015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1306,"thread_start_us":13529,"threads_started":1}
W20260923 19:42:41.341359 22762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:41.342177 22751 server_base.cc:1034] running on GCE node
I20260923 19:42:41.342857 22751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:41.344105 22751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:41.345975 22751 hybrid_clock.cc:648] HybridClock initialized: now 1790192561345881 us; error 84 us; skew 500 ppm
I20260923 19:42:41.346369 22751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192561, etypes {rep=17 tkt=17 ses=17}, oryx/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:42:41.349754 22751 init.cc:377] Logged in from keytab as oryx/127.13.88.195@KRBTEST.COM (short username oryx)
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:41.351671 22751 webserver.cc:460] Webserver started at http://127.13.88.195:45355/ using document root <none> and password file <none>
I20260923 19:42:41.352439 22751 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:41.352602 22751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:41.353917 22617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:41.341422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:48867)
0923 19:42:41.341628 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:41.341671 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:41.341814 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:41.342370 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:41.342378 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:41.342976 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:41.343288 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.343305 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.344658 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.344665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.345778 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.345791 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.346758 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.346768 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.347000 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.347939 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:41.347975 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:41.353478 (+ 5503us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 19:42:41.353963 22616 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:41.341805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:48867 (local address 127.13.88.254:44965)
0923 19:42:41.341965 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:41.341969 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:41.341983 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:42:41.342045 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:41.342052 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:41.342127 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:41.342233 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:41.343466 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.344512 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.345920 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.346531 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.346682 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.353707 (+ 7025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:48867: BlockingRecv error: recv got EOF from 127.13.88.193:48867 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260923 19:42:41.354350 22614 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:42:41.358551 22751 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 19:42:41.361584 22769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:41.363318 22751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:41.363472 22751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "3dd1aba7c72a491aa0cc5c3e5d93ac74"
format_stamp: "Formatted at 2026-09-23 19:42:38 on dist-test-slave-xg7f"
server_key: "447e3798f7ac1bcfd5888446af42081a"
server_key_iv: "7eea5803fe50fc28a1486421cac62263"
server_key_version: "encryptionkey@0"
I20260923 19:42:41.364410 22751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:41.376556 22751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:41.383782 22751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:41.384209 22751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:41.385864 22751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:41.388305 22751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:41.388464 22751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:41.388614 22751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:41.388765 22751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:41.433068 22751 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:38261
I20260923 19:42:41.433247 22881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:38261 every 8 connection(s)
I20260923 19:42:41.434473 22751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:41.438815 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 22751
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:41.458921 22760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:41.440206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36630 (local address 127.13.88.254:44965)
0923 19:42:41.440384 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:41.440389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:41.440601 (+ 212us) server_negotiation.cc:407] Connection header received
0923 19:42:41.440828 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:41.440831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:41.440892 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:41.440996 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:41.442379 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.443228 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.444578 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.445011 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.445136 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.448329 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:41.448345 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:41.448375 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:41.448450 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:41.454163 (+ 5713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:41.455076 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:41.455089 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:41.455144 (+ 55us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:41.455445 (+ 301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:42:41.455905 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:42:41.455913 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:42:41.455919 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:42:41.456825 (+ 906us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:41.457262 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:41.457733 (+ 471us) server_negotiation.cc:299] Negotiation successful
0923 19:42:41.458317 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260923 19:42:41.760185 22749 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.114s user 0.007s sys 0.005s
I20260923 19:42:41.761725 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:40.630538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:54637)
0923 19:42:40.631886 (+ 1348us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:40.631971 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:40.635698 (+ 3727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:40.639972 (+ 4274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:40.639997 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:40.640702 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:40.641323 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:40.641340 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.642352 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.642356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:40.643676 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:40.643688 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.644597 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.644607 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:40.644918 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:40.645653 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:40.645677 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:41.760898 (+1115221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":745,"thread_start_us":618,"threads_started":1}
W20260923 19:42:41.761785 22750 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:40.631146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:54637 (local address 127.13.88.254:44965)
0923 19:42:40.638953 (+ 7807us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:40.638964 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:40.638997 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:42:40.639260 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:40.639268 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:40.639433 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:40.639709 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:40.641498 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.642197 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.643952 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:40.644375 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:40.644508 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.761296 (+1116788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:54637: BlockingRecv error: recv got EOF from 127.13.88.194:54637 (error 108)
Metrics: {"server-negotiator.queue_time_us":7588,"thread_start_us":7425,"threads_started":1}
W20260923 19:42:41.762782 22747 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:44965 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.88.254:44965: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
W20260923 19:42:41.773720 22750 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:41.764072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:51355 (local address 127.13.88.254:44965)
0923 19:42:41.764242 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:41.764246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:41.764260 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:42:41.764301 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:41.764304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:41.764359 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:41.764459 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:41.765116 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.765850 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.767065 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.767508 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.767642 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.773530 (+ 5888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:51355: BlockingRecv error: recv got EOF from 127.13.88.194:51355 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:42:41.773967 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:41.763629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:51355)
0923 19:42:41.763821 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:41.763837 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:41.763928 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:41.764486 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:41.764491 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:41.764840 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:41.764987 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.764995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.765979 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.765985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.766938 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.766949 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.767669 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.767676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.767833 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.768635 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:41.768654 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:41.773410 (+ 4756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":71}
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:41 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:41.786317 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:41.774796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:54041)
0923 19:42:41.774999 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:41.775026 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:41.775181 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:41.775540 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:41.775548 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:41.776106 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:41.776398 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.776413 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.777382 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.777390 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.779697 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.779712 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.780425 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.780434 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.780706 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.781419 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:41.781454 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:41.786022 (+ 4568us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:42:41.786473 22750 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:41.774933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:54041 (local address 127.13.88.254:44965)
0923 19:42:41.775064 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:41.775068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:41.775081 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:42:41.775322 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:41.775325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:41.775388 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:41.775457 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:41.776549 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.777237 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.779857 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.780259 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.780347 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.786205 (+ 5858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:54041: BlockingRecv error: recv got EOF from 127.13.88.194:54041 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260923 19:42:41.786711 22747 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:42.365414 22887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:42.355053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:42137)
0923 19:42:42.355659 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:42.355681 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:42.355813 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:42.356224 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:42.356230 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:42.356632 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:42.356772 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.356780 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.357783 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.357788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.358944 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.358956 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.360511 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.360515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.360635 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.361235 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:42.361253 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:42.365175 (+ 3922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":363,"threads_started":1}
W20260923 19:42:42.365942 22888 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:42.355184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:42137 (local address 127.13.88.254:44965)
0923 19:42:42.355923 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:42.355929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:42.355949 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:42:42.355989 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:42.355992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:42.356053 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:42.356162 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:42.356924 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.357654 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.359142 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.360322 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.360501 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.365561 (+ 5060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:42137: BlockingRecv error: recv got EOF from 127.13.88.193:42137 (error 108)
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":477,"threads_started":1}
W20260923 19:42:42.520130 22884 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.068s user 0.001s sys 0.012s
W20260923 19:42:42.521239 22616 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:41.437936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:33457 (local address 127.13.88.254:44965)
0923 19:42:41.438128 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:41.438134 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:41.440280 (+ 2146us) server_negotiation.cc:407] Connection header received
0923 19:42:41.444141 (+ 3861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:41.444147 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:41.444239 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:41.444339 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:41.447424 (+ 3085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.448370 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.450112 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.450572 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.450737 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.520991 (+1070254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:33457: BlockingRecv error: recv got EOF from 127.13.88.195:33457 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:42:42.521888 22884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:41.438598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:33457)
0923 19:42:41.440063 (+ 1465us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:41.440141 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:41.443731 (+ 3590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:41.444737 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:41.444755 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:41.445841 (+ 1086us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:41.447183 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.447220 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.448542 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.448548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.449974 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:41.449986 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:41.450829 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:41.450836 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:41.451067 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:41.451743 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:41.451764 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:42.520854 (+1069090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":961,"thread_start_us":643,"threads_started":1}
W20260923 19:42:42.522936 22882 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:44965 (0 consecutive failures): Not authorized: Failed to ping master at 127.13.88.254:44965: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:42.531755 22884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:42.523608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:55741)
0923 19:42:42.523816 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:42.523836 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:42.523937 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:42.524271 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:42.524277 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:42.524757 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:42.524916 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.524925 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.525972 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.525975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.526921 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.526931 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.527644 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.527648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.527761 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.528276 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:42.528292 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:42.531479 (+ 3187us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":69}
W20260923 19:42:42.531920 22616 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:42.523691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:55741 (local address 127.13.88.254:44965)
0923 19:42:42.523905 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:42.523912 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:42.523931 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:42:42.524034 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:42.524039 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:42.524115 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:42.524230 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:42.525028 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.525854 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.527020 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.527510 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.527597 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.531677 (+ 4080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:55741: BlockingRecv error: recv got EOF from 127.13.88.195:55741 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:42.540118 22884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:42.532339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:58171)
0923 19:42:42.532481 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:42.532498 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:42.532577 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:42.532902 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:42.532905 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:42.533153 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:42.533322 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.533329 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.534201 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.534204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.535237 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.535253 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.536135 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.536142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.536355 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.536923 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:42.536939 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:42.539953 (+ 3014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:42:42.540292 22616 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:42.532527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:58171 (local address 127.13.88.254:44965)
0923 19:42:42.532665 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:42.532669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:42.532682 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:42:42.532718 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:42.532721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:42.532784 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:42.532859 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:42.533431 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.534104 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.535372 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.535935 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.536097 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.540111 (+ 4014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:58171: BlockingRecv error: recv got EOF from 127.13.88.195:58171 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260923 19:42:42.540421 22882 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:42 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:42.796139 22889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:42.787489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:53875)
0923 19:42:42.788059 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:42.788074 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:42.788184 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:42.788482 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:42.788485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:42.788880 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:42.789023 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.789031 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.789973 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.789977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.790962 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:42.790992 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.791686 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.791690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:42.791810 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.792355 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:42.792372 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:42.795847 (+ 3475us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":337,"threads_started":1}
W20260923 19:42:42.796347 22616 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:42.787554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:53875 (local address 127.13.88.254:44965)
0923 19:42:42.787709 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:42.787713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:42.788142 (+ 429us) server_negotiation.cc:407] Connection header received
0923 19:42:42.788288 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:42.788291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:42.788359 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:42.788433 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:42.789134 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.789868 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.791119 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:42.791529 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:42.791615 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:42.796087 (+ 4472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:53875: BlockingRecv error: recv got EOF from 127.13.88.194:53875 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 23 19:42:43 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:43 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:43.375366 22890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:43.366583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:45739)
0923 19:42:43.367078 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:43.367094 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:43.367294 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:43.367714 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:43.367719 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:43.368313 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:43.368555 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:43.368571 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.369568 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.369571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:43.370463 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:43.370473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.371096 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.371133 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:43.371259 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:43.371799 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:43.371816 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:43.375023 (+ 3207us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":291,"threads_started":1}
W20260923 19:42:43.375452 22891 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:43.366664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:45739 (local address 127.13.88.254:44965)
0923 19:42:43.367398 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:43.367403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:43.367421 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:42:43.367470 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:43.367475 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:43.367544 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:43.367666 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:43.368701 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.369447 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.370572 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.370981 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.371075 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:43.375256 (+ 4181us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:45739: BlockingRecv error: recv got EOF from 127.13.88.193:45739 (error 108)
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":543,"threads_started":1}
Sep 23 19:42:43 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:43 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:43.550215 22892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:43.541123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:44395)
0923 19:42:43.541788 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:43.541804 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:43.541915 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:43.542200 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:43.542203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:43.542571 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:43.542712 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:43.542719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.543751 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.543755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:43.544927 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:43.544940 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.545789 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.545796 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:43.545971 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:43.546559 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:43.546577 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:43.549881 (+ 3304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":427,"threads_started":1}
W20260923 19:42:43.550446 22891 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:43.541191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:44395 (local address 127.13.88.254:44965)
0923 19:42:43.541348 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:43.541353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:43.541873 (+ 520us) server_negotiation.cc:407] Connection header received
0923 19:42:43.542019 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:43.542023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:43.542080 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:43.542168 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:43.542858 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.543636 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.545062 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.545590 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.545727 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:43.550066 (+ 4339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:44395: BlockingRecv error: recv got EOF from 127.13.88.195:44395 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Sep 23 19:42:43 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:43 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:43.805301 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:43.796948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:43247)
0923 19:42:43.797361 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:43.797376 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:43.797502 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:43.797794 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:43.797797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:43.798171 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:43.798353 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:43.798361 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.799275 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.799278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:43.800126 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:43.800135 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.800725 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.800729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:43.800836 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:43.801380 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:43.801397 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:43.805052 (+ 3655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":232,"threads_started":1}
W20260923 19:42:43.805517 22891 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:43.797035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:43247 (local address 127.13.88.254:44965)
0923 19:42:43.797274 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:43.797281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:43.797446 (+ 165us) server_negotiation.cc:407] Connection header received
0923 19:42:43.797595 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:43.797598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:43.797657 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:43.797731 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:43.798464 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.799174 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.800254 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:43.800604 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:43.800682 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:43.805263 (+ 4581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:43247: BlockingRecv error: recv got EOF from 127.13.88.194:43247 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Sep 23 19:42:44 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:44 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:44.384939 22894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:44.376303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:50013)
0923 19:42:44.376809 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:44.376826 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:44.376925 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:44.377267 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:44.377270 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:44.377591 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:44.377762 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:44.377771 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.378783 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.378786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:44.379803 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:44.379815 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.380639 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.380644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:44.380774 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:44.381332 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:44.381349 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:44.384572 (+ 3223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":281,"threads_started":1}
W20260923 19:42:44.385048 22895 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:44.376568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:50013 (local address 127.13.88.254:44965)
0923 19:42:44.377005 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:44.377010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:44.377024 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:42:44.377068 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:44.377071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:44.377135 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:44.377227 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:44.377883 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.378651 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.379916 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.380519 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.380609 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:44.384782 (+ 4173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:50013: BlockingRecv error: recv got EOF from 127.13.88.193:50013 (error 108)
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":239,"threads_started":1}
Sep 23 19:42:44 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:44 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:44.564585 22896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:44.551154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:52469)
0923 19:42:44.551753 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:44.551774 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:44.551904 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:44.555880 (+ 3976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:44.555885 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:44.556410 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:44.556660 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:44.556673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.558165 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.558170 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:44.559494 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:44.559506 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.560132 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.560136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:44.560260 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:44.560817 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:44.560834 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:44.564250 (+ 3416us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":302,"threads_started":1}
W20260923 19:42:44.564656 22895 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:44.551216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:52469 (local address 127.13.88.254:44965)
0923 19:42:44.551535 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:44.551543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:44.555178 (+ 3635us) server_negotiation.cc:407] Connection header received
0923 19:42:44.555264 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:44.555269 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:44.555347 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:44.555441 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:44.556831 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.557999 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.559630 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.560013 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.560104 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:44.564432 (+ 4328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:52469: BlockingRecv error: recv got EOF from 127.13.88.195:52469 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Sep 23 19:42:44 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:44 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:44.815213 22897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:44.806480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:40519)
0923 19:42:44.807033 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:44.807048 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:44.807236 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:44.807596 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:44.807600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:44.807983 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:44.808159 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:44.808167 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.809241 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.809250 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:44.810191 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:44.810202 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.810892 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.810898 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:44.811077 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:44.811784 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:44.811801 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:44.814864 (+ 3063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":288,"threads_started":1}
W20260923 19:42:44.815352 22895 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:44.806567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:40519 (local address 127.13.88.254:44965)
0923 19:42:44.806743 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:44.806747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:44.807278 (+ 531us) server_negotiation.cc:407] Connection header received
0923 19:42:44.807346 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:44.807350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:44.807452 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:44.807557 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:44.808303 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.809052 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.810329 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:44.810755 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:44.810878 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:44.815056 (+ 4178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:40519: BlockingRecv error: recv got EOF from 127.13.88.194:40519 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 23 19:42:45 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:45 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:45.394644 22898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:45.385928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:47649)
0923 19:42:45.386450 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:45.386466 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:45.386570 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:45.386948 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:45.386951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:45.387342 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:45.387518 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:45.387526 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.388839 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.388843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:45.389943 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:45.389955 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.390556 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.390560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:45.390690 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:45.391279 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:45.391297 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:45.394291 (+ 2994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":286,"threads_started":1}
W20260923 19:42:45.394698 22899 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:45.385990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:47649 (local address 127.13.88.254:44965)
0923 19:42:45.386475 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:45.386479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:45.386520 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:42:45.386731 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:45.386735 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:45.386813 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:45.386905 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:45.387676 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.388728 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.390061 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.390443 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.390534 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:45.394471 (+ 3937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:47649: BlockingRecv error: recv got EOF from 127.13.88.193:47649 (error 108)
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":285,"threads_started":1}
Sep 23 19:42:45 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:45 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:45.578512 22900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:45.565813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:49749)
0923 19:42:45.566327 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:45.566342 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:45.566445 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:45.566757 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:45.566760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:45.567288 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:45.567520 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:45.567534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.569212 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.569216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:45.570112 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:45.570122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.571003 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.571007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:45.571198 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:45.574492 (+ 3294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:45.574509 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:45.578287 (+ 3778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":263,"threads_started":1}
W20260923 19:42:45.578722 22899 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:45.565870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:49749 (local address 127.13.88.254:44965)
0923 19:42:45.566084 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:45.566090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:45.566411 (+ 321us) server_negotiation.cc:407] Connection header received
0923 19:42:45.566543 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:45.566548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:45.566636 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:45.566734 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:45.567945 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.569091 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.570237 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.570879 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.571004 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:45.578469 (+ 7465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:49749: BlockingRecv error: recv got EOF from 127.13.88.195:49749 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Sep 23 19:42:45 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:45 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:45.825381 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:45.816208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:34475)
0923 19:42:45.816807 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:45.816825 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:45.816941 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:45.817247 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:45.817250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:45.817637 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:45.817808 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:45.817816 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.818807 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.818811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:45.819807 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:45.819818 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.820545 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.820549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:45.820684 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:45.821310 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:45.821327 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:45.825057 (+ 3730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":309,"threads_started":1}
W20260923 19:42:45.825459 22899 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:45.816310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:34475 (local address 127.13.88.254:44965)
0923 19:42:45.816469 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:45.816473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:45.816916 (+ 443us) server_negotiation.cc:407] Connection header received
0923 19:42:45.817027 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:45.817037 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:45.817115 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:45.817198 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:45.817931 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.818696 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.819969 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:45.820414 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:45.820508 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:45.825258 (+ 4750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:34475: BlockingRecv error: recv got EOF from 127.13.88.194:34475 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 23 19:42:46 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:46 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:46.404322 22902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:46.395592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:58671)
0923 19:42:46.396114 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:46.396140 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:46.396252 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:46.396602 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:46.396608 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:46.397165 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:46.397355 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:46.397367 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.398537 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.398541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:46.399488 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:46.399498 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.400097 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.400102 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:46.400229 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:46.400789 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:46.400806 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:46.404097 (+ 3291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":279,"threads_started":1}
W20260923 19:42:46.404549 22903 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:46.395661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:58671 (local address 127.13.88.254:44965)
0923 19:42:46.396089 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:46.396093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:46.396230 (+ 137us) server_negotiation.cc:407] Connection header received
0923 19:42:46.396346 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:46.396351 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:46.396425 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:46.396537 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:46.397505 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.398424 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.399605 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.399988 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.400074 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:46.404298 (+ 4224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:58671: BlockingRecv error: recv got EOF from 127.13.88.193:58671 (error 108)
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":253,"threads_started":1}
Sep 23 19:42:46 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:46 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:46.588347 22904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:46.579465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:52981)
0923 19:42:46.579931 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:46.579946 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:46.580050 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:46.580336 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:46.580339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:46.580681 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:46.580837 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:46.580845 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.581813 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.581816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:46.582900 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:46.582912 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.583727 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.583732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:46.583911 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:46.584540 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:46.584558 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:46.587990 (+ 3432us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":257,"threads_started":1}
W20260923 19:42:46.588423 22903 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:46.579535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:52981 (local address 127.13.88.254:44965)
0923 19:42:46.579760 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:46.579766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:46.580018 (+ 252us) server_negotiation.cc:407] Connection header received
0923 19:42:46.580145 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:46.580148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:46.580210 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:46.580290 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:46.580946 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.581686 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.583021 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.583575 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.583703 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:46.588190 (+ 4487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:52981: BlockingRecv error: recv got EOF from 127.13.88.195:52981 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 23 19:42:46 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:46 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:46.835695 22905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:46.826333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:55415)
0923 19:42:46.826900 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:46.826916 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:46.827027 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:46.827389 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:46.827392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:46.827819 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:46.827959 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:46.827968 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.828982 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.828986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:46.829892 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:46.829902 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.830550 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.830554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:46.830682 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:46.831355 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:46.831378 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:46.835362 (+ 3984us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":318,"threads_started":1}
W20260923 19:42:46.835798 22903 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:46.826491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:55415 (local address 127.13.88.254:44965)
0923 19:42:46.826645 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:46.826649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:46.826983 (+ 334us) server_negotiation.cc:407] Connection header received
0923 19:42:46.827150 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:46.827154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:46.827257 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:46.827349 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:46.828100 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.828846 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.830009 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:46.830433 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:46.830525 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:46.835550 (+ 5025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:55415: BlockingRecv error: recv got EOF from 127.13.88.194:55415 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 23 19:42:47 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:47 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:47.414525 22906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:47.405174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:37499)
0923 19:42:47.406255 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:47.406278 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:47.406436 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:47.406777 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:47.406784 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:47.407300 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:47.407466 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:47.407475 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.408497 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.408504 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:47.409430 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:47.409441 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.410200 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.410207 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:47.410383 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:47.410927 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:47.410949 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:47.414158 (+ 3209us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":960,"thread_start_us":847,"threads_started":1}
W20260923 19:42:47.414621 22907 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:47.405234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:37499 (local address 127.13.88.254:44965)
0923 19:42:47.405835 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:47.405839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:47.406372 (+ 533us) server_negotiation.cc:407] Connection header received
0923 19:42:47.406550 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:47.406555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:47.406630 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:47.406739 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:47.407606 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.408362 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.409629 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.410039 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.410168 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:47.414344 (+ 4176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:37499: BlockingRecv error: recv got EOF from 127.13.88.193:37499 (error 108)
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":315,"threads_started":1}
Sep 23 19:42:47 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:47 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:47.598100 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:47.589368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:42599)
0923 19:42:47.589892 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:47.589908 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:47.590017 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:47.590320 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:47.590323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:47.590733 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:47.590872 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:47.590880 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.591916 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.591920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:47.592814 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:47.592825 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.593444 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.593448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:47.593579 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:47.594168 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:47.594184 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:47.597793 (+ 3609us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":267,"threads_started":1}
W20260923 19:42:47.598167 22907 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:47.589446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:42599 (local address 127.13.88.254:44965)
0923 19:42:47.589610 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:47.589614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:47.589981 (+ 367us) server_negotiation.cc:407] Connection header received
0923 19:42:47.590110 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:47.590114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:47.590180 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:47.590267 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:47.590989 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.591782 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.592927 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.593329 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.593420 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:47.597966 (+ 4546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:42599: BlockingRecv error: recv got EOF from 127.13.88.195:42599 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Sep 23 19:42:47 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:47 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:47.845021 22909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:47.836623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:40037)
0923 19:42:47.837085 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:47.837100 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:47.837215 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:47.837487 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:47.837490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:47.837870 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:47.838061 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:47.838068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.839048 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.839051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:47.840146 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:47.840158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.840766 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.840770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:47.840879 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:47.841398 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:47.841414 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:47.844710 (+ 3296us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":252,"threads_started":1}
W20260923 19:42:47.845094 22907 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:47.836692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:40037 (local address 127.13.88.254:44965)
0923 19:42:47.836838 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:47.836842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:47.837164 (+ 322us) server_negotiation.cc:407] Connection header received
0923 19:42:47.837303 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:47.837307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:47.837376 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:47.837454 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:47.838231 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.838938 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.840268 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:47.840647 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:47.840739 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:47.844884 (+ 4145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:40037: BlockingRecv error: recv got EOF from 127.13.88.194:40037 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Sep 23 19:42:48 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:48 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:48.424401 22911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:48.415417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:34261)
0923 19:42:48.416014 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:48.416029 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:48.416137 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:48.416429 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:48.416432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:48.416829 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:48.416990 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:48.416998 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.418188 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.418194 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:48.419182 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:48.419195 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.419913 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.419919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:48.420098 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:48.420694 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:48.420712 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:48.424055 (+ 3343us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":335,"threads_started":1}
W20260923 19:42:48.424537 22910 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:48.415501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:34261 (local address 127.13.88.254:44965)
0923 19:42:48.415982 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:48.415989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:48.416106 (+ 117us) server_negotiation.cc:407] Connection header received
0923 19:42:48.416242 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:48.416245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:48.416305 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:48.416392 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:48.417112 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.418041 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.419322 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.419752 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.419891 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:48.424260 (+ 4369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:34261: BlockingRecv error: recv got EOF from 127.13.88.193:34261 (error 108)
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":250,"threads_started":1}
Sep 23 19:42:48 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:48 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:48.607450 22912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:48.599043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:47835)
0923 19:42:48.599529 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:48.599545 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:48.599648 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:48.599929 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:48.599932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:48.600294 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:48.600447 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:48.600455 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.601371 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.601374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:48.602315 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:48.602325 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.602970 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.602975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:48.603091 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:48.603693 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:48.603709 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:48.607225 (+ 3516us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":272,"threads_started":1}
W20260923 19:42:48.607615 22910 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:48.599177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:47835 (local address 127.13.88.254:44965)
0923 19:42:48.599332 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:48.599336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:48.599609 (+ 273us) server_negotiation.cc:407] Connection header received
0923 19:42:48.599747 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:48.599750 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:48.599814 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:48.599889 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:48.600562 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.601270 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.602422 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.602839 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.602922 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:48.607383 (+ 4461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:47835: BlockingRecv error: recv got EOF from 127.13.88.195:47835 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 23 19:42:48 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:48 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:48.854941 22913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:48.846057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:56349)
0923 19:42:48.846620 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:48.846637 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:48.846750 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:48.847055 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:48.847059 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:48.847482 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:48.847642 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:48.847650 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.848594 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.848597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:48.849523 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:48.849535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.850384 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.850389 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:48.850563 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:48.851313 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:48.851330 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:48.854692 (+ 3362us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":272,"threads_started":1}
W20260923 19:42:48.855103 22910 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:48.846134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:56349 (local address 127.13.88.254:44965)
0923 19:42:48.846326 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:48.846330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:48.846712 (+ 382us) server_negotiation.cc:407] Connection header received
0923 19:42:48.846852 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:48.846856 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:48.846929 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:48.847014 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:48.847760 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.848485 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.849653 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:48.850230 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:48.850361 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:48.854866 (+ 4505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:56349: BlockingRecv error: recv got EOF from 127.13.88.194:56349 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Sep 23 19:42:49 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:49 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:49.435361 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:49.425336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:52609)
0923 19:42:49.425944 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:49.425968 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:49.426100 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:49.426474 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:49.426479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:49.427025 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:49.427276 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:49.427286 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.428535 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.428540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:49.429928 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:49.429939 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.430692 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.430698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:49.430871 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:49.431448 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:49.431467 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:49.435007 (+ 3540us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":253,"threads_started":1}
W20260923 19:42:49.435513 22915 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:49.425409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:52609 (local address 127.13.88.254:44965)
0923 19:42:49.426159 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:49.426167 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:49.426185 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:42:49.426242 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:49.426251 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:49.426319 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:49.426439 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:49.427421 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.428408 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.430067 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.430507 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.430644 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:49.435284 (+ 4640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:52609: BlockingRecv error: recv got EOF from 127.13.88.193:52609 (error 108)
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":488,"threads_started":1}
Sep 23 19:42:49 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:49 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:49.616890 22916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:49.608417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:39357)
0923 19:42:49.609005 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:49.609022 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:49.609135 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:49.609400 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:49.609403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:49.609812 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:49.609972 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:49.609980 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.610949 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.610952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:49.611929 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:49.611940 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.612588 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.612592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:49.612699 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:49.613331 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:49.613349 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:49.616650 (+ 3301us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":290,"threads_started":1}
W20260923 19:42:49.617152 22915 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:49.608592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:39357 (local address 127.13.88.254:44965)
0923 19:42:49.608766 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:49.608770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:49.609138 (+ 368us) server_negotiation.cc:407] Connection header received
0923 19:42:49.609211 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:49.609214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:49.609274 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:49.609364 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:49.610105 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.610828 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.612053 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.612463 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.612556 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:49.616911 (+ 4355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:39357: BlockingRecv error: recv got EOF from 127.13.88.195:39357 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 23 19:42:49 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:49 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:49.865239 22917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:49.856078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:51181)
0923 19:42:49.856586 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:49.856601 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:49.856720 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:49.857022 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:49.857025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:49.857411 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:49.857569 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:49.857578 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.858719 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.858723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:49.859815 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:49.859831 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.860794 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.860800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:49.860968 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:49.861678 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:49.861696 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:49.864994 (+ 3298us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":271,"threads_started":1}
W20260923 19:42:49.865411 22915 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:49.856175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:51181 (local address 127.13.88.254:44965)
0923 19:42:49.856409 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:49.856416 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:49.856689 (+ 273us) server_negotiation.cc:407] Connection header received
0923 19:42:49.856817 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:49.856821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:49.856895 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:49.856977 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:49.857710 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.858586 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.859997 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:49.860592 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:49.860759 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:49.865180 (+ 4421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:51181: BlockingRecv error: recv got EOF from 127.13.88.194:51181 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Sep 23 19:42:50 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:50 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:50.444766 22918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:50.436448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:59689)
0923 19:42:50.436975 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:50.436990 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:50.437099 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:50.437396 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:50.437399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:50.437777 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:50.437913 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:50.437920 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.438867 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.438871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:50.439954 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:50.439966 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.440625 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.440629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:50.440749 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:50.441299 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:50.441317 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:50.444542 (+ 3225us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":315,"threads_started":1}
W20260923 19:42:50.445004 22919 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:50.436476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:59689 (local address 127.13.88.254:44965)
0923 19:42:50.436929 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:50.436933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:50.437066 (+ 133us) server_negotiation.cc:407] Connection header received
0923 19:42:50.437190 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:50.437193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:50.437264 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:50.437346 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:50.438025 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.438745 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.440071 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.440480 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.440584 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:50.444738 (+ 4154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:59689: BlockingRecv error: recv got EOF from 127.13.88.193:59689 (error 108)
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":262,"threads_started":1}
Sep 23 19:42:50 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:50 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:50.632030 22920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:50.617918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:43375)
0923 19:42:50.618473 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:50.618489 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:50.618603 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:50.618885 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:50.618888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:50.619292 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:50.619462 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:50.619470 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.620429 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.620432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:50.621369 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:50.621379 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.622033 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.622037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:50.622152 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:50.628260 (+ 6108us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:50.628278 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:50.631793 (+ 3515us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":299,"threads_started":1}
W20260923 19:42:50.632167 22919 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:50.617974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:43375 (local address 127.13.88.254:44965)
0923 19:42:50.618152 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:50.618156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:50.618566 (+ 410us) server_negotiation.cc:407] Connection header received
0923 19:42:50.618698 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:50.618701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:50.618759 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:50.618845 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:50.619584 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.620324 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.621485 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.621874 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.621958 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:50.631965 (+ 10007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:43375: BlockingRecv error: recv got EOF from 127.13.88.195:43375 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Sep 23 19:42:50 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:50 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:50.874907 22921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:50.866308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:42553)
0923 19:42:50.866840 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:50.866855 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:50.867009 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:50.867437 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:50.867440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:50.867826 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:50.867959 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:50.867967 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.869037 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.869040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:50.869967 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:50.869977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.870604 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.870609 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:50.870812 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:50.871455 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:50.871471 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:50.874676 (+ 3205us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":260,"threads_started":1}
W20260923 19:42:50.875101 22919 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:50.866363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:42553 (local address 127.13.88.254:44965)
0923 19:42:50.866599 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:50.866607 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:50.866950 (+ 343us) server_negotiation.cc:407] Connection header received
0923 19:42:50.867170 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:50.867175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:50.867296 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:50.867399 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:50.868100 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.868915 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.870079 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:50.870470 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:50.870561 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:50.874855 (+ 4294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:42553: BlockingRecv error: recv got EOF from 127.13.88.194:42553 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 23 19:42:51 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:51 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:51.454512 22922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:51.445834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:53421)
0923 19:42:51.446358 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:51.446375 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:51.446478 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:51.446798 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:51.446801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:51.447179 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:51.447338 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:51.447346 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.448313 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.448316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:51.449263 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:51.449273 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.449925 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.449929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:51.450036 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:51.450680 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:51.450698 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:51.454297 (+ 3599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":290,"threads_started":1}
W20260923 19:42:51.454692 22923 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:51.445916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:53421 (local address 127.13.88.254:44965)
0923 19:42:51.446415 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:51.446419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:51.446437 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:42:51.446587 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:51.446591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:51.446648 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:51.446745 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:51.447466 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.448189 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.449378 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.449798 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.449888 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:51.454473 (+ 4585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:53421: BlockingRecv error: recv got EOF from 127.13.88.193:53421 (error 108)
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":307,"threads_started":1}
Sep 23 19:42:51 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:51 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:51.641441 22924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:51.632935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:45675)
0923 19:42:51.633382 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:51.633398 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:51.633499 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:51.633770 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:51.633773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:51.634153 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:51.634292 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:51.634299 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.635339 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.635343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:51.636247 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:51.636257 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.636849 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.636853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:51.636967 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:51.637474 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:51.637489 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:51.641123 (+ 3634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":239,"threads_started":1}
W20260923 19:42:51.641718 22923 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:51.633024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:45675 (local address 127.13.88.254:44965)
0923 19:42:51.633265 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:51.633271 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:51.633473 (+ 202us) server_negotiation.cc:407] Connection header received
0923 19:42:51.633593 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:51.633596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:51.633657 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:51.633738 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:51.634405 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.635223 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.636356 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.636731 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.636816 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:51.641403 (+ 4587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:45675: BlockingRecv error: recv got EOF from 127.13.88.195:45675 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Sep 23 19:42:51 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:51 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:51.884429 22925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:51.875843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:57495)
0923 19:42:51.876410 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:51.876425 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:51.876537 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:51.876919 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:51.876922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:51.877378 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:51.877565 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:51.877578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.878706 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.878710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:51.879698 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:51.879709 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.880306 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.880310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:51.880413 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:51.881073 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:51.881090 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:51.884203 (+ 3113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":339,"threads_started":1}
W20260923 19:42:51.884603 22923 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:51.875953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:57495 (local address 127.13.88.254:44965)
0923 19:42:51.876121 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:51.876125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:51.876520 (+ 395us) server_negotiation.cc:407] Connection header received
0923 19:42:51.876675 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:51.876679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:51.876759 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:51.876864 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:51.877727 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.878570 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.879820 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:51.880187 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:51.880273 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:51.884364 (+ 4091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:57495: BlockingRecv error: recv got EOF from 127.13.88.194:57495 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Sep 23 19:42:52 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:52 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:52.464238 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:52.455581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:34165)
0923 19:42:52.456043 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:52.456059 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:52.456154 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:52.456618 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:52.456621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:52.456998 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:52.457195 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:52.457206 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.458222 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.458229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:52.459142 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:52.459153 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.459857 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.459863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:52.460025 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:52.460591 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:52.460626 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:52.464014 (+ 3388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":242,"threads_started":1}
W20260923 19:42:52.464496 22927 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:52.455778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:34165 (local address 127.13.88.254:44965)
0923 19:42:52.456364 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:52.456368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:52.456383 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:42:52.456425 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:52.456428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:52.456490 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:52.456575 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:52.457336 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.458065 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.459278 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.459698 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.459829 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:52.464218 (+ 4389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:34165: BlockingRecv error: recv got EOF from 127.13.88.193:34165 (error 108)
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":371,"threads_started":1}
Sep 23 19:42:52 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:52 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:52.651396 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:52.642384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:32885)
0923 19:42:52.642914 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:52.642930 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:52.643046 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:52.643385 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:52.643388 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:52.643730 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:52.643904 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:52.643912 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.644888 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.644891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:52.645959 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:52.645973 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.646599 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.646603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:52.646712 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:52.647351 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:52.647367 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:52.651085 (+ 3718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":292,"threads_started":1}
W20260923 19:42:52.651537 22927 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:52.642484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:32885 (local address 127.13.88.254:44965)
0923 19:42:52.642650 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:52.642654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:52.643007 (+ 353us) server_negotiation.cc:407] Connection header received
0923 19:42:52.643192 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:52.643195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:52.643256 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:52.643340 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:52.644045 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.644781 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.646085 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.646474 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.646564 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:52.651324 (+ 4760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:32885: BlockingRecv error: recv got EOF from 127.13.88.195:32885 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 23 19:42:52 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:52 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:52.894331 22929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:52.885492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:33099)
0923 19:42:52.886067 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:52.886083 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:52.886227 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:52.886530 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:52.886533 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:52.886930 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:52.887135 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:52.887145 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.888145 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.888148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:52.889013 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:52.889025 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.889667 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.889671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:52.889785 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:52.890364 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:52.890380 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:52.894049 (+ 3669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":315,"threads_started":1}
W20260923 19:42:52.894554 22927 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:52.885587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:33099 (local address 127.13.88.254:44965)
0923 19:42:52.885773 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:52.885777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:52.886219 (+ 442us) server_negotiation.cc:407] Connection header received
0923 19:42:52.886331 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:52.886335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:52.886408 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:52.886486 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:52.887281 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.888034 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.889143 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:52.889544 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:52.889637 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:52.894229 (+ 4592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:33099: BlockingRecv error: recv got EOF from 127.13.88.194:33099 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Sep 23 19:42:53 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:53 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:53.474225 22930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:53.465196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:60103)
0923 19:42:53.465715 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:53.465731 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:53.465833 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:53.466259 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:53.466263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:53.466651 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:53.466826 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:53.466835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.468068 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.468073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:53.469181 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:53.469194 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.469823 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.469827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:53.469947 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:53.470531 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:53.470548 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:53.473878 (+ 3330us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":263,"threads_started":1}
W20260923 19:42:53.474551 22931 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:53.465321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:60103 (local address 127.13.88.254:44965)
0923 19:42:53.465983 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:53.465987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:53.466001 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:42:53.466064 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:53.466067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:53.466127 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:53.466215 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:53.466959 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.467933 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.469300 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.469680 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.469774 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:53.474089 (+ 4315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:60103: BlockingRecv error: recv got EOF from 127.13.88.193:60103 (error 108)
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":455,"threads_started":1}
Sep 23 19:42:53 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:53 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:53.660333 22932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:53.652268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:49181)
0923 19:42:53.652711 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:53.652727 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:53.652838 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:53.653124 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:53.653128 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:53.653540 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:53.653733 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:53.653742 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.654706 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.654710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:53.655697 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:53.655708 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.656306 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.656310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:53.656425 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:53.656989 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:53.657006 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:53.660118 (+ 3112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":241,"threads_started":1}
W20260923 19:42:53.660480 22931 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:53.652408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:49181 (local address 127.13.88.254:44965)
0923 19:42:53.652628 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:53.652634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:53.652804 (+ 170us) server_negotiation.cc:407] Connection header received
0923 19:42:53.652945 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:53.652948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:53.653004 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:53.653077 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:53.653845 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.654598 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.655826 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.656183 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.656276 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:53.660286 (+ 4010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:49181: BlockingRecv error: recv got EOF from 127.13.88.195:49181 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Sep 23 19:42:53 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:53 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:53.904978 22933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:53.895523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:51421)
0923 19:42:53.896106 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:53.896121 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:53.896247 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:53.896553 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:53.896556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:53.896985 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:53.897150 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:53.897157 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.898146 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.898150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:53.899374 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:53.899391 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.900405 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.900410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:53.900603 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:53.901362 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:53.901381 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:53.904742 (+ 3361us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":316,"threads_started":1}
W20260923 19:42:53.905165 22931 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:53.895559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:51421 (local address 127.13.88.254:44965)
0923 19:42:53.895731 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:53.895736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:53.896212 (+ 476us) server_negotiation.cc:407] Connection header received
0923 19:42:53.896348 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:53.896351 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:53.896425 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:53.896507 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:53.897263 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.897993 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.899567 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:53.900234 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:53.900369 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:53.904919 (+ 4550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:51421: BlockingRecv error: recv got EOF from 127.13.88.194:51421 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 23 19:42:54 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:54 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:54.483716 22934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:54.475267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:49953)
0923 19:42:54.475697 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:54.475713 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:54.475810 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:54.476380 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:54.476383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:54.476752 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:54.476889 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:54.476897 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.477794 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.477798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:54.478745 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:54.478756 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.479480 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.479484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:54.479604 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:54.480144 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:54.480167 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:54.483365 (+ 3198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":234,"threads_started":1}
W20260923 19:42:54.483814 22935 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:54.475277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:49953 (local address 127.13.88.254:44965)
0923 19:42:54.476133 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:54.476137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:54.476149 (+ 12us) server_negotiation.cc:407] Connection header received
0923 19:42:54.476187 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:54.476189 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:54.476242 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:54.476318 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:54.477005 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.477686 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.478872 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.479359 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.479447 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:54.483531 (+ 4084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:49953: BlockingRecv error: recv got EOF from 127.13.88.193:49953 (error 108)
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":691,"threads_started":1}
Sep 23 19:42:54 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:54 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:54.670949 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:54.661358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:50715)
0923 19:42:54.661976 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:54.661992 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:54.662178 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:54.662537 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:54.662542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:54.663029 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:54.663271 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:54.663281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.664329 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.664336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:54.665401 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:54.665414 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.666197 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.666203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:54.666385 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:54.667045 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:54.667064 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:54.670590 (+ 3526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":336,"threads_started":1}
W20260923 19:42:54.671031 22935 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:54.661483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:50715 (local address 127.13.88.254:44965)
0923 19:42:54.661751 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:54.661760 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:54.662104 (+ 344us) server_negotiation.cc:407] Connection header received
0923 19:42:54.662321 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:54.662325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:54.662388 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:54.662504 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:54.663418 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.664172 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.665553 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.666008 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.666154 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:54.670802 (+ 4648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:50715: BlockingRecv error: recv got EOF from 127.13.88.195:50715 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Sep 23 19:42:54 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:54 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:54.914224 22937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:54.905893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:39807)
0923 19:42:54.906340 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:54.906355 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:54.906461 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:54.906741 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:54.906744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:54.907152 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:54.907300 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:54.907336 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.908313 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.908316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:54.909271 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:54.909281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.909886 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.909890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:54.910005 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:54.910626 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:54.910643 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:54.913994 (+ 3351us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":253,"threads_started":1}
W20260923 19:42:54.914402 22935 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:54.906017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:39807 (local address 127.13.88.254:44965)
0923 19:42:54.906256 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:54.906261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:54.906427 (+ 166us) server_negotiation.cc:407] Connection header received
0923 19:42:54.906547 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:54.906550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:54.906620 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:54.906702 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:54.907453 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.908203 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.909394 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:54.909771 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:54.909859 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:54.914175 (+ 4316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:39807: BlockingRecv error: recv got EOF from 127.13.88.194:39807 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Sep 23 19:42:55 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:55 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.193@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:55.493973 22938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:55.484913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.193:44257)
0923 19:42:55.485400 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:55.485417 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:55.485517 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:55.486000 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:55.486003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:55.486355 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:55.486531 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:55.486539 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.487616 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.487620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:55.488495 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:55.488506 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.489134 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.489138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:55.489264 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:55.489847 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:55.489864 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:55.493742 (+ 3878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":232,"threads_started":1}
W20260923 19:42:55.494172 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:55.485019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:44257 (local address 127.13.88.254:44965)
0923 19:42:55.485686 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:55.485690 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:55.485705 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:42:55.485772 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:55.485775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:55.485839 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:55.485935 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:55.486725 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.487484 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.488617 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.489018 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.489102 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:55.493931 (+ 4829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.193:44257: BlockingRecv error: recv got EOF from 127.13.88.193:44257 (error 108)
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":470,"threads_started":1}
Sep 23 19:42:55 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:55 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.195@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:55.684130 22940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:55.672149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.195:39117)
0923 19:42:55.672617 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:55.672636 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:55.672769 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:55.673185 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:55.673190 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:55.673705 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:55.673900 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:55.673914 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.675185 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.675191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:55.676085 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:55.676103 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.676790 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.676795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:55.676972 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:55.680540 (+ 3568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:55.680557 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:55.683887 (+ 3330us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":242,"threads_started":1}
W20260923 19:42:55.684303 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:55.672244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:39117 (local address 127.13.88.254:44965)
0923 19:42:55.672494 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:55.672500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:55.672739 (+ 239us) server_negotiation.cc:407] Connection header received
0923 19:42:55.672927 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:55.672935 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:55.673034 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:55.673146 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:55.674051 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.675013 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.676243 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.676645 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.676782 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:55.684073 (+ 7291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.195:39117: BlockingRecv error: recv got EOF from 127.13.88.195:39117 (error 108)
Metrics: {"server-negotiator.queue_time_us":135}
Sep 23 19:42:55 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
Sep 23 19:42:55 dist-test-slave-xg7f krb5kdc[21879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.13.88.194@KRBTEST.COM for oryx/127.13.88.254@KRBTEST.COM, Server not found in Kerberos database
I20260923 19:42:55.925161 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:55.915687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:44965 (local address 127.13.88.194:42327)
0923 19:42:55.916366 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:55.916381 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:55.916486 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:55.916901 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:55.916905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:55.917308 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:55.917491 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:55.917499 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.918504 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.918508 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:55.919526 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:55.919539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.920179 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.920184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:55.920325 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:55.921002 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:42:55.921032 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:55.924882 (+ 3850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.13.88.254:44965: Server oryx/127.13.88.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":253,"threads_started":1}
W20260923 19:42:55.925415 22939 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:55.915838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:42327 (local address 127.13.88.254:44965)
0923 19:42:55.916052 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:55.916058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:55.916455 (+ 397us) server_negotiation.cc:407] Connection header received
0923 19:42:55.916647 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:55.916650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:55.916742 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:55.916839 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:55.917616 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.918363 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.919648 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:55.920042 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:55.920131 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:55.925118 (+ 4987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.13.88.194:42327: BlockingRecv error: recv got EOF from 127.13.88.194:42327 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:42:56.439548 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22466
I20260923 19:42:56.451535 22943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:56.440679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.13.88.193:46653)
0923 19:42:56.441378 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:56.441386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:56.441412 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:42:56.441479 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:56.441485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:56.441732 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:56.441893 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:56.443298 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:56.444343 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:56.445414 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:56.445916 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:56.446012 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:56.448476 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:56.448484 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:56.448498 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:56.448548 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:56.450938 (+ 2390us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.88.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0923 19:42:56.451320 (+ 382us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53106: Request ticket server kudu/127.13.88.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":381,"threads_started":1}
W20260923 19:42:56.451678 22943 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53106: Request ticket server kudu/127.13.88.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260923 19:42:56.451685 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22466: Not authorized: Client connection negotiation failed: client connection to 127.13.88.193:46653: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.88.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260923 19:42:56.451941 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 22466
I20260923 19:42:56.468729 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22618
I20260923 19:42:56.481781 22944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:56.469786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.13.88.194:34079)
0923 19:42:56.470390 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:56.470397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:56.470421 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:42:56.470483 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:56.470490 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:56.470742 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:56.470905 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:56.472861 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:56.474101 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:56.475363 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:56.475921 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:56.476020 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:56.478385 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:56.478393 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:56.478407 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:56.478463 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:56.481219 (+ 2756us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.88.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0923 19:42:56.481498 (+ 279us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58088: Request ticket server kudu/127.13.88.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":318,"threads_started":1}
W20260923 19:42:56.481859 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22618: Not authorized: Client connection negotiation failed: client connection to 127.13.88.194:34079: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.88.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260923 19:42:56.481884 22944 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58088: Request ticket server kudu/127.13.88.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260923 19:42:56.482028 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 22618
I20260923 19:42:56.498744 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22751
I20260923 19:42:56.510773 22945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:56.499910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46790 (local address 127.13.88.195:38261)
0923 19:42:56.500589 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:56.500598 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:56.500630 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:42:56.500705 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:56.500713 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:56.501014 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:56.501235 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:56.502504 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:56.503858 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:56.504910 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:56.505403 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:56.505488 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:56.507811 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:56.507819 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:56.507832 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:42:56.507879 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:56.510247 (+ 2368us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.88.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0923 19:42:56.510530 (+ 283us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46790: Request ticket server kudu/127.13.88.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":313,"threads_started":1}
W20260923 19:42:56.510895 22945 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46790: Request ticket server kudu/127.13.88.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260923 19:42:56.510901 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22751: Not authorized: Client connection negotiation failed: client connection to 127.13.88.195:38261: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.13.88.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260923 19:42:56.511055 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 22751
I20260923 19:42:56.527307 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22397
I20260923 19:42:56.528717 22459 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:56.643664 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 22397
2026-09-23T19:42:56Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21484 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-23T19:42:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:56Z Disabled control of system clock
I20260923 19:42:56.718362 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36697
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:37609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:36697
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 19:42:57.035352 22950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:57.035656 22950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:57.035734 22950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:57.043080 22950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:57.043239 22950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:57.043277 22950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:57.043326 22950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:57.043371 22950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:57.052649 22950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:37609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:36697
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:57.053905 22950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:57.055716 22950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:57.067692 22958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:57.067662 22956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:57.067720 22955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:57.068281 22950 server_base.cc:1034] running on GCE node
I20260923 19:42:57.069196 22950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:57.070604 22950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:57.071832 22950 hybrid_clock.cc:648] HybridClock initialized: now 1790192577071778 us; error 45 us; skew 500 ppm
I20260923 19:42:57.072198 22950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:57.074433 22950 webserver.cc:460] Webserver started at http://127.13.88.254:35499/ using document root <none> and password file <none>
I20260923 19:42:57.075191 22950 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:57.075317 22950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:57.075636 22950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:57.078624 22950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "1d04ef67e97142158a8dfc1da8800f0f"
format_stamp: "Formatted at 2026-09-23 19:42:57 on dist-test-slave-xg7f"
server_key: "e3916aad02e7f8966c59be0b244670ac"
server_key_iv: "d2b2a96de464edc3c4ddecf59b7bb9e4"
server_key_version: "encryptionkey@0"
I20260923 19:42:57.079468 22950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "1d04ef67e97142158a8dfc1da8800f0f"
format_stamp: "Formatted at 2026-09-23 19:42:57 on dist-test-slave-xg7f"
server_key: "e3916aad02e7f8966c59be0b244670ac"
server_key_iv: "d2b2a96de464edc3c4ddecf59b7bb9e4"
server_key_version: "encryptionkey@0"
I20260923 19:42:57.084650 22950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:42:57.087888 22964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:57.089179 22950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:57.089371 22950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "1d04ef67e97142158a8dfc1da8800f0f"
format_stamp: "Formatted at 2026-09-23 19:42:57 on dist-test-slave-xg7f"
server_key: "e3916aad02e7f8966c59be0b244670ac"
server_key_iv: "d2b2a96de464edc3c4ddecf59b7bb9e4"
server_key_version: "encryptionkey@0"
I20260923 19:42:57.089596 22950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:57.119894 22950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:57.120791 22950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:57.121097 22950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:57.139214 22950 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:36697
I20260923 19:42:57.139300 23015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:36697 every 8 connection(s)
I20260923 19:42:57.140601 22950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:57.144335 23016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:57.149123 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 22950
I20260923 19:42:57.149443 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:57.150035 13667 external_mini_cluster.cc:1428] Setting key c9bb408728cdd2bc467394210e6c5a86
I20260923 19:42:57.155376 23016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f: Bootstrap starting.
I20260923 19:42:57.159186 23016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:57.160394 23016 log.cc:824] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:57.163803 23016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f: No bootstrap required, opened a new log
I20260923 19:42:57.164227 23019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:57.152104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36164 (local address 127.13.88.254:36697)
0923 19:42:57.153143 (+ 1039us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:57.153155 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:57.153199 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:42:57.154838 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:57.154861 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:57.155417 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:57.155795 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:57.156476 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:57.157768 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:57.159683 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:57.160352 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:57.160486 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:57.161775 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:57.161786 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:57.161804 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:57.162399 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:57.162476 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:57.162498 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:57.162589 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:57.162849 (+ 260us) server_negotiation.cc:299] Negotiation successful
0923 19:42:57.163225 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":370,"threads_started":1}
I20260923 19:42:57.171993 23016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d04ef67e97142158a8dfc1da8800f0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36697 } }
I20260923 19:42:57.172379 23016 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:57.172510 23016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d04ef67e97142158a8dfc1da8800f0f, State: Initialized, Role: FOLLOWER
I20260923 19:42:57.173280 23016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d04ef67e97142158a8dfc1da8800f0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36697 } }
I20260923 19:42:57.173580 23016 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:57.173725 23016 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:57.173913 23016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:57.176323 23016 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d04ef67e97142158a8dfc1da8800f0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36697 } }
I20260923 19:42:57.176874 23016 leader_election.cc:302] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d04ef67e97142158a8dfc1da8800f0f; no voters:
I20260923 19:42:57.177547 23016 leader_election.cc:288] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:57.177726 23021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:57.178695 23021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [term 1 LEADER]: Becoming Leader. State: Replica: 1d04ef67e97142158a8dfc1da8800f0f, State: Running, Role: LEADER
I20260923 19:42:57.179327 23021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d04ef67e97142158a8dfc1da8800f0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36697 } }
I20260923 19:42:57.179991 23016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:57.182168 23023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d04ef67e97142158a8dfc1da8800f0f. Latest consensus state: current_term: 1 leader_uuid: "1d04ef67e97142158a8dfc1da8800f0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d04ef67e97142158a8dfc1da8800f0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36697 } } }
I20260923 19:42:57.182375 23022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d04ef67e97142158a8dfc1da8800f0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d04ef67e97142158a8dfc1da8800f0f" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36697 } } }
I20260923 19:42:57.182610 23023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:57.182633 23022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:57.184190 23030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:57.189272 23030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:57.197611 23030 catalog_manager.cc:1347] Generated new cluster ID: bcdc670fc11445e7846f44be87f44f57
I20260923 19:42:57.197732 23030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:57.214341 23030 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:57.216261 23030 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:57.225260 23030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d04ef67e97142158a8dfc1da8800f0f: Generated new TSK 0
I20260923 19:42:57.226135 23030 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:42:57.240896 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36697
--builtin_ntp_servers=127.13.88.212:37609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260923 19:42:57.591794 23040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:57.592113 23040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:57.592283 23040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:57.599789 23040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:57.600029 23040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:57.600216 23040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:42:57.609288 23040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:37609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:57.610580 23040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:57.612430 23040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:57.625497 23048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:57.625530 23045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:57.625463 23046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:57.626356 23040 server_base.cc:1034] running on GCE node
I20260923 19:42:57.627043 23040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:57.628057 23040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:57.629261 23040 hybrid_clock.cc:648] HybridClock initialized: now 1790192577629217 us; error 31 us; skew 500 ppm
I20260923 19:42:57.629598 23040 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:57.631822 23040 webserver.cc:460] Webserver started at http://127.13.88.193:38009/ using document root <none> and password file <none>
I20260923 19:42:57.632500 23040 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:57.632619 23040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:57.632949 23040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:57.635708 23040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "bb683565e68a4db8939d8800cb42aac5"
format_stamp: "Formatted at 2026-09-23 19:42:57 on dist-test-slave-xg7f"
server_key: "6d46602e052311e9393693f1bcb172f6"
server_key_iv: "b5ea758e0534a2ea0a70460639aab72c"
server_key_version: "encryptionkey@0"
I20260923 19:42:57.636456 23040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "bb683565e68a4db8939d8800cb42aac5"
format_stamp: "Formatted at 2026-09-23 19:42:57 on dist-test-slave-xg7f"
server_key: "6d46602e052311e9393693f1bcb172f6"
server_key_iv: "b5ea758e0534a2ea0a70460639aab72c"
server_key_version: "encryptionkey@0"
I20260923 19:42:57.641512 23040 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:42:57.644758 23054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:57.645958 23040 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 19:42:57.646126 23040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "bb683565e68a4db8939d8800cb42aac5"
format_stamp: "Formatted at 2026-09-23 19:42:57 on dist-test-slave-xg7f"
server_key: "6d46602e052311e9393693f1bcb172f6"
server_key_iv: "b5ea758e0534a2ea0a70460639aab72c"
server_key_version: "encryptionkey@0"
I20260923 19:42:57.646330 23040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:57.660163 23040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:57.660997 23040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:57.661300 23040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:57.662293 23040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:57.664402 23040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:57.664527 23040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:57.664675 23040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:57.664753 23040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:57.700662 23040 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:46039
I20260923 19:42:57.700724 23166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:46039 every 8 connection(s)
I20260923 19:42:57.701980 23040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:42:57.709263 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23040
I20260923 19:42:57.709442 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:42:57.710253 13667 external_mini_cluster.cc:1428] Setting key 476c4a042f093bc3131cb9db969b58dc
I20260923 19:42:57.713165 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36697
--builtin_ntp_servers=127.13.88.212:37609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 19:42:57.714843 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:57.704436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:58417 (local address 127.13.88.254:36697)
0923 19:42:57.704870 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:57.704874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:57.706056 (+ 1182us) server_negotiation.cc:407] Connection header received
0923 19:42:57.707784 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:57.707788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:57.707850 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:57.707941 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:57.708921 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:57.710093 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:57.711885 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:57.712460 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:57.712581 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:57.713881 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:57.713890 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:57.713899 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:57.713923 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:57.713976 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:57.713994 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:57.714095 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:57.714289 (+ 194us) server_negotiation.cc:299] Negotiation successful
0923 19:42:57.714397 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":228,"threads_started":1}
I20260923 19:42:57.715659 23170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:57.705043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36697 (local address 127.13.88.193:58417)
0923 19:42:57.705886 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:57.705942 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:57.707555 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:57.708140 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:57.708148 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:57.708228 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:57.708760 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:57.708774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:57.710224 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:57.710228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:57.711733 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:57.711746 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:57.712674 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:57.712679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:57.712882 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:57.713580 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:57.713583 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:57.713623 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:57.713695 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:57.714095 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:57.714102 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:57.714108 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:42:57.714248 (+ 140us) client_negotiation.cc:240] Negotiation successful
0923 19:42:57.714535 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":245,"threads_started":1}
I20260923 19:42:57.717167 23167 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36697
I20260923 19:42:57.717473 23167 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:57.718384 23167 heartbeater.cc:511] Master 127.13.88.254:36697 requested a full tablet report, sending...
I20260923 19:42:57.720554 22981 ts_manager.cc:194] Registered new tserver with Master: bb683565e68a4db8939d8800cb42aac5 (127.13.88.193:46039)
I20260923 19:42:57.722060 22981 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.193:58417
W20260923 19:42:58.039983 23171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:58.040259 23171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:58.040412 23171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:58.048156 23171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:58.048255 23171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:58.048432 23171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:42:58.057647 23171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:37609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:58.058939 23171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:58.060775 23171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:58.073705 23176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:58.073756 23179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:58.073705 23177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:58.075249 23171 server_base.cc:1034] running on GCE node
I20260923 19:42:58.075907 23171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:58.076879 23171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:58.078126 23171 hybrid_clock.cc:648] HybridClock initialized: now 1790192578078056 us; error 63 us; skew 500 ppm
I20260923 19:42:58.078460 23171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:58.081166 23171 webserver.cc:460] Webserver started at http://127.13.88.194:43547/ using document root <none> and password file <none>
I20260923 19:42:58.081888 23171 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:58.082032 23171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:58.082362 23171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:58.085596 23171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "2769a4f7dc464c149f96436330690230"
format_stamp: "Formatted at 2026-09-23 19:42:58 on dist-test-slave-xg7f"
server_key: "a33d9b4a5ecfee8163216bdc5b4c767f"
server_key_iv: "20ab273ec98156cc76fdc7aaeb26977f"
server_key_version: "encryptionkey@0"
I20260923 19:42:58.086469 23171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "2769a4f7dc464c149f96436330690230"
format_stamp: "Formatted at 2026-09-23 19:42:58 on dist-test-slave-xg7f"
server_key: "a33d9b4a5ecfee8163216bdc5b4c767f"
server_key_iv: "20ab273ec98156cc76fdc7aaeb26977f"
server_key_version: "encryptionkey@0"
I20260923 19:42:58.091773 23171 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:42:58.095402 23185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:58.096753 23171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:42:58.096930 23171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "2769a4f7dc464c149f96436330690230"
format_stamp: "Formatted at 2026-09-23 19:42:58 on dist-test-slave-xg7f"
server_key: "a33d9b4a5ecfee8163216bdc5b4c767f"
server_key_iv: "20ab273ec98156cc76fdc7aaeb26977f"
server_key_version: "encryptionkey@0"
I20260923 19:42:58.097146 23171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:58.109067 23171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:58.109911 23171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:58.110222 23171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:58.111245 23171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:58.112707 23171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:58.112838 23171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:58.112967 23171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:58.113060 23171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:58.146303 23171 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:46409
I20260923 19:42:58.146337 23297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:46409 every 8 connection(s)
I20260923 19:42:58.147740 23171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:42:58.157400 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23171
I20260923 19:42:58.157575 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:42:58.158044 13667 external_mini_cluster.cc:1428] Setting key 8917b16074e5c4ab490b41f671665c55
I20260923 19:42:58.160889 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36697
--builtin_ntp_servers=127.13.88.212:37609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 19:42:58.161734 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:58.150388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:43875 (local address 127.13.88.254:36697)
0923 19:42:58.150603 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:58.150610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:58.152306 (+ 1696us) server_negotiation.cc:407] Connection header received
0923 19:42:58.154747 (+ 2441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:58.154751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:58.154817 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:58.154918 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:58.156232 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.156928 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.158677 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.159203 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.159388 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:58.160774 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:58.160781 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:58.160785 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:58.160804 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:58.160842 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:58.160856 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:58.160949 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:58.161223 (+ 274us) server_negotiation.cc:299] Negotiation successful
0923 19:42:58.161326 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":65}
I20260923 19:42:58.162611 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:58.150959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36697 (local address 127.13.88.194:43875)
0923 19:42:58.152123 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:58.152180 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:58.154448 (+ 2268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:58.155191 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:58.155203 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:58.155335 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:58.156062 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:58.156084 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.157092 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.157097 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:58.158530 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:58.158542 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.159396 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.159401 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:58.159633 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:58.160431 (+ 798us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:58.160434 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:58.160474 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:58.160555 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:58.160957 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:58.160963 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:58.160969 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:42:58.161200 (+ 231us) client_negotiation.cc:240] Negotiation successful
0923 19:42:58.161483 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":357,"threads_started":1}
I20260923 19:42:58.164042 23298 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36697
I20260923 19:42:58.164394 23298 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:58.165259 23298 heartbeater.cc:511] Master 127.13.88.254:36697 requested a full tablet report, sending...
I20260923 19:42:58.166733 22981 ts_manager.cc:194] Registered new tserver with Master: 2769a4f7dc464c149f96436330690230 (127.13.88.194:46409)
I20260923 19:42:58.167608 22981 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.194:43875
W20260923 19:42:58.486011 23301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:58.486279 23301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:58.486442 23301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:58.494032 23301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:58.494148 23301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:58.494374 23301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:42:58.503409 23301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:37609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:58.504721 23301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:58.506518 23301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:58.519379 23307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:58.519420 23306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:58.519455 23309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:58.520164 23301 server_base.cc:1034] running on GCE node
I20260923 19:42:58.520764 23301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:58.521657 23301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:58.522872 23301 hybrid_clock.cc:648] HybridClock initialized: now 1790192578522832 us; error 53 us; skew 500 ppm
I20260923 19:42:58.523254 23301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:58.525527 23301 webserver.cc:460] Webserver started at http://127.13.88.195:37049/ using document root <none> and password file <none>
I20260923 19:42:58.526259 23301 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:58.526386 23301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:58.526715 23301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:58.529592 23301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "c12315725cf64d7f9dc0a8eb0bc07f32"
format_stamp: "Formatted at 2026-09-23 19:42:58 on dist-test-slave-xg7f"
server_key: "1de993fc0c0277312732cdcf64f45444"
server_key_iv: "58e6e27b83dafc2a98e43844405aad28"
server_key_version: "encryptionkey@0"
I20260923 19:42:58.530342 23301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "c12315725cf64d7f9dc0a8eb0bc07f32"
format_stamp: "Formatted at 2026-09-23 19:42:58 on dist-test-slave-xg7f"
server_key: "1de993fc0c0277312732cdcf64f45444"
server_key_iv: "58e6e27b83dafc2a98e43844405aad28"
server_key_version: "encryptionkey@0"
I20260923 19:42:58.535334 23301 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:42:58.538707 23315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:58.540011 23301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:42:58.540192 23301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "c12315725cf64d7f9dc0a8eb0bc07f32"
format_stamp: "Formatted at 2026-09-23 19:42:58 on dist-test-slave-xg7f"
server_key: "1de993fc0c0277312732cdcf64f45444"
server_key_iv: "58e6e27b83dafc2a98e43844405aad28"
server_key_version: "encryptionkey@0"
I20260923 19:42:58.540414 23301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:58.595736 23301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:58.596625 23301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:58.596947 23301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:58.597932 23301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:42:58.599431 23301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:42:58.599563 23301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:58.599709 23301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:42:58.599794 23301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:58.631963 23301 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:37263
I20260923 19:42:58.632047 23427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:37263 every 8 connection(s)
I20260923 19:42:58.633242 23301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:42:58.634821 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23301
I20260923 19:42:58.634971 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:42:58.635469 13667 external_mini_cluster.cc:1428] Setting key 37c3b9d626285d1b0d18e7e54ede7e6e
I20260923 19:42:58.646057 23169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:58.636484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:45577 (local address 127.13.88.254:36697)
0923 19:42:58.636695 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:58.636701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:58.638327 (+ 1626us) server_negotiation.cc:407] Connection header received
0923 19:42:58.640158 (+ 1831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:58.640162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:58.640224 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:58.640302 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:58.641258 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.641946 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.643522 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.643999 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.644101 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:58.645429 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:58.645434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:58.645437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:58.645453 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:58.645482 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:58.645493 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:58.645558 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:58.645743 (+ 185us) server_negotiation.cc:299] Negotiation successful
0923 19:42:58.645813 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:42:58.647030 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:58.637135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36697 (local address 127.13.88.195:45577)
0923 19:42:58.638169 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0923 19:42:58.638212 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:42:58.639925 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:42:58.640491 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:42:58.640498 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:42:58.640590 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:42:58.641131 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:58.641145 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.642073 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.642076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:58.643402 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:42:58.643413 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.644181 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.644186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:42:58.644370 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:58.645139 (+ 769us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:42:58.645142 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:42:58.645178 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:42:58.645251 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:42:58.645573 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:42:58.645579 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:42:58.645585 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:42:58.645719 (+ 134us) client_negotiation.cc:240] Negotiation successful
0923 19:42:58.645997 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":322,"threads_started":1}
I20260923 19:42:58.648552 23428 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36697
I20260923 19:42:58.648849 23428 heartbeater.cc:464] Registering TS with master...
I20260923 19:42:58.649830 23428 heartbeater.cc:511] Master 127.13.88.254:36697 requested a full tablet report, sending...
I20260923 19:42:58.651242 22981 ts_manager.cc:194] Registered new tserver with Master: c12315725cf64d7f9dc0a8eb0bc07f32 (127.13.88.195:37263)
I20260923 19:42:58.652053 22981 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.195:45577
I20260923 19:42:58.662925 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 19:42:58.668707 23169 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:42:58.667241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36180 (local address 127.13.88.254:36697)
0923 19:42:58.667491 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:58.667499 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:58.667844 (+ 345us) server_negotiation.cc:407] Connection header received
0923 19:42:58.667976 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:58.667981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:58.668052 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:58.668132 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:58.668477 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36180: BlockingRecv error: recv got EOF from 127.0.0.1:36180 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:42:58.669643 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23040
I20260923 19:42:58.676982 23437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:58.670445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41872 (local address 127.13.88.193:46039)
0923 19:42:58.670975 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:58.670982 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:58.671008 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:42:58.671066 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:58.671072 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:58.671336 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:58.671465 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:58.671804 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.672757 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.673944 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.674472 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.674563 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:58.675639 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:58.675653 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:58.675666 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:58.676268 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:58.676311 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:58.676333 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:58.676414 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:58.676567 (+ 153us) server_negotiation.cc:299] Negotiation successful
0923 19:42:58.676688 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":276,"threads_started":1}
I20260923 19:42:58.678195 23162 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:58.758783 23167 heartbeater.cc:503] Master 127.13.88.254:36697 was elected leader, sending a full tablet report...
I20260923 19:42:58.760171 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23040
W20260923 19:42:58.775854 22966 connection.cc:535] server connection from 127.13.88.193:58417 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:42:58.776193 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23171
I20260923 19:42:58.784004 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:58.777042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46334 (local address 127.13.88.194:46409)
0923 19:42:58.777527 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:58.777534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:58.777560 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:42:58.777617 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:58.777631 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:58.777845 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:58.777965 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:58.778356 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.779480 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.780758 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.781424 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.781519 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:58.782445 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:58.782453 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:58.782467 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:58.783079 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:58.783182 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:58.783202 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:58.783287 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:58.783515 (+ 228us) server_negotiation.cc:299] Negotiation successful
0923 19:42:58.783649 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":227,"threads_started":1}
I20260923 19:42:58.785375 23293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:58.865424 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23171
I20260923 19:42:58.881476 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23301
I20260923 19:42:58.889681 23441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:58.882592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44784 (local address 127.13.88.195:37263)
0923 19:42:58.883316 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:58.883323 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:58.883353 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:42:58.883412 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:58.883418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:58.883685 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:58.883811 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:58.884172 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.885332 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.886486 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:42:58.887022 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:42:58.887193 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:42:58.888225 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:58.888234 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:58.888248 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:58.888858 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:58.888900 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:58.888918 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:58.889039 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:58.889199 (+ 160us) server_negotiation.cc:299] Negotiation successful
0923 19:42:58.889324 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":340,"threads_started":1}
I20260923 19:42:58.890899 23423 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:58.970875 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23301
I20260923 19:42:58.987088 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 22950
I20260923 19:42:58.988377 23011 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:42:59.090255 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 22950
2026-09-23T19:42:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2440 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-23T19:42:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:42:59Z Disabled control of system clock
I20260923 19:42:59.161396 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:39431
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:39431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 19:42:59.502836 23447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:42:59.503135 23447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:42:59.503275 23447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:42:59.511247 23447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:42:59.511361 23447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:42:59.511458 23447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:42:59.511579 23447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:42:59.511689 23447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:42:59.521097 23447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:39431
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:39431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:42:59.522524 23447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:42:59.524389 23447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:42:59.536093 23452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:59.536157 23453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:42:59.536181 23455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:42:59.537267 23447 server_base.cc:1034] running on GCE node
I20260923 19:42:59.538151 23447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:42:59.539712 23447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:42:59.540951 23447 hybrid_clock.cc:648] HybridClock initialized: now 1790192579540902 us; error 48 us; skew 500 ppm
I20260923 19:42:59.541301 23447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:42:59.543741 23447 webserver.cc:460] Webserver started at http://127.13.88.254:45543/ using document root <none> and password file <none>
I20260923 19:42:59.544483 23447 fs_manager.cc:359] Metadata directory not provided
I20260923 19:42:59.544627 23447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:42:59.544951 23447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:42:59.547951 23447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "a46e41587d434d148c7c49b371bcff82"
format_stamp: "Formatted at 2026-09-23 19:42:59 on dist-test-slave-xg7f"
server_key: "5ceeca090de74173db4b96eaa95954fe"
server_key_iv: "aedd909b529dd8710154802985f08a49"
server_key_version: "encryptionkey@0"
I20260923 19:42:59.548724 23447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "a46e41587d434d148c7c49b371bcff82"
format_stamp: "Formatted at 2026-09-23 19:42:59 on dist-test-slave-xg7f"
server_key: "5ceeca090de74173db4b96eaa95954fe"
server_key_iv: "aedd909b529dd8710154802985f08a49"
server_key_version: "encryptionkey@0"
I20260923 19:42:59.553959 23447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:42:59.557503 23461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:42:59.558852 23447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:42:59.559049 23447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "a46e41587d434d148c7c49b371bcff82"
format_stamp: "Formatted at 2026-09-23 19:42:59 on dist-test-slave-xg7f"
server_key: "5ceeca090de74173db4b96eaa95954fe"
server_key_iv: "aedd909b529dd8710154802985f08a49"
server_key_version: "encryptionkey@0"
I20260923 19:42:59.559346 23447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:42:59.565069 23447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:42:59.565912 23447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:42:59.566214 23447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:42:59.583909 23447 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:39431
I20260923 19:42:59.583943 23512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:39431 every 8 connection(s)
I20260923 19:42:59.585292 23447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:42:59.589210 23513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:42:59.592670 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23447
I20260923 19:42:59.592895 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:42:59.593485 13667 external_mini_cluster.cc:1428] Setting key 76c4e02327cd6b59f161bcc083737ed4
I20260923 19:42:59.602869 23516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:42:59.595553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54282 (local address 127.13.88.254:39431)
0923 19:42:59.596743 (+ 1190us) server_negotiation.cc:206] Beginning negotiation
0923 19:42:59.596760 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:42:59.596819 (+ 59us) server_negotiation.cc:407] Connection header received
0923 19:42:59.598604 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:42:59.598641 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:42:59.599296 (+ 655us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:42:59.599796 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:42:59.600864 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:42:59.600872 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:42:59.600890 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:42:59.600909 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:42:59.600984 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:42:59.601014 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:42:59.601244 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0923 19:42:59.601368 (+ 124us) server_negotiation.cc:299] Negotiation successful
0923 19:42:59.601635 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":355,"threads_started":1}
I20260923 19:42:59.603415 23513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82: Bootstrap starting.
I20260923 19:42:59.606729 23513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82: Neither blocks nor log segments found. Creating new log.
I20260923 19:42:59.607911 23513 log.cc:824] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82: Log is configured to *not* fsync() on all Append() calls
I20260923 19:42:59.610487 23513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82: No bootstrap required, opened a new log
I20260923 19:42:59.617748 23513 raft_consensus.cc:348] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46e41587d434d148c7c49b371bcff82" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39431 } }
I20260923 19:42:59.618080 23513 raft_consensus.cc:374] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:42:59.618151 23513 raft_consensus.cc:729] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46e41587d434d148c7c49b371bcff82, State: Initialized, Role: FOLLOWER
I20260923 19:42:59.618633 23513 consensus_queue.cc:260] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46e41587d434d148c7c49b371bcff82" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39431 } }
I20260923 19:42:59.618817 23513 raft_consensus.cc:388] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:42:59.618909 23513 raft_consensus.cc:482] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:42:59.619027 23513 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:42:59.621120 23513 raft_consensus.cc:504] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46e41587d434d148c7c49b371bcff82" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39431 } }
I20260923 19:42:59.621553 23513 leader_election.cc:302] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a46e41587d434d148c7c49b371bcff82; no voters:
I20260923 19:42:59.622270 23513 leader_election.cc:288] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:42:59.622400 23518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:42:59.623137 23518 raft_consensus.cc:686] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [term 1 LEADER]: Becoming Leader. State: Replica: a46e41587d434d148c7c49b371bcff82, State: Running, Role: LEADER
I20260923 19:42:59.623756 23518 consensus_queue.cc:237] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46e41587d434d148c7c49b371bcff82" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39431 } }
I20260923 19:42:59.624663 23513 sys_catalog.cc:564] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:42:59.626575 23520 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a46e41587d434d148c7c49b371bcff82. Latest consensus state: current_term: 1 leader_uuid: "a46e41587d434d148c7c49b371bcff82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46e41587d434d148c7c49b371bcff82" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39431 } } }
I20260923 19:42:59.626956 23520 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:59.626722 23519 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a46e41587d434d148c7c49b371bcff82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46e41587d434d148c7c49b371bcff82" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 39431 } } }
I20260923 19:42:59.627193 23519 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82 [sys.catalog]: This master's current role is: LEADER
I20260923 19:42:59.628980 23525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:42:59.633622 23525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:42:59.642618 23525 catalog_manager.cc:1347] Generated new cluster ID: 6704fc723c90451bb88688a1fe32b6d3
I20260923 19:42:59.642742 23525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:42:59.675793 23525 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:42:59.676293 23525 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:42:59.687747 23525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a46e41587d434d148c7c49b371bcff82: Generated new TSK 0
I20260923 19:42:59.688654 23525 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:42:59.705561 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39431
--builtin_ntp_servers=127.13.88.212:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 19:43:00.036158 23537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:00.036468 23537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:00.036638 23537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:00.044106 23537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:00.044225 23537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:00.044397 23537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:43:00.053970 23537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39431
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:00.055621 23537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:00.057410 23537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:00.070525 23545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:00.070588 23542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:00.070619 23543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:00.071696 23537 server_base.cc:1034] running on GCE node
I20260923 19:43:00.072257 23537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:00.073176 23537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:00.074366 23537 hybrid_clock.cc:648] HybridClock initialized: now 1790192580074316 us; error 45 us; skew 500 ppm
I20260923 19:43:00.074653 23537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:43:00.077145 23537 webserver.cc:460] Webserver started at http://127.13.88.193:36399/ using document root <none> and password file <none>
I20260923 19:43:00.077855 23537 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:00.077942 23537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:00.078204 23537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:43:00.081029 23537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "fb5e87caa886458f81097113d8c9671e"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "1e7bf30ffaf9d1bbdb47580283789596"
server_key_iv: "0b2efc372c1db4cb38527a82a2b7099d"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.081758 23537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "fb5e87caa886458f81097113d8c9671e"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "1e7bf30ffaf9d1bbdb47580283789596"
server_key_iv: "0b2efc372c1db4cb38527a82a2b7099d"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.086666 23537 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:43:00.090226 23551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:00.091729 23537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:43:00.091863 23537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "fb5e87caa886458f81097113d8c9671e"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "1e7bf30ffaf9d1bbdb47580283789596"
server_key_iv: "0b2efc372c1db4cb38527a82a2b7099d"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.092041 23537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:00.097488 23537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:00.098199 23537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:00.098415 23537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:00.099361 23537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:00.100695 23537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:00.100777 23537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:00.100867 23537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:00.100925 23537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:00.133882 23537 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:41845
I20260923 19:43:00.133980 23663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:41845 every 8 connection(s)
I20260923 19:43:00.135304 23537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:43:00.137434 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23537
I20260923 19:43:00.137656 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:43:00.138456 13667 external_mini_cluster.cc:1428] Setting key 3451d925d0d3fb91f16d7228a952bfbc
I20260923 19:43:00.141112 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39431
--builtin_ntp_servers=127.13.88.212:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260923 19:43:00.144240 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:00.138020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:44713 (local address 127.13.88.254:39431)
0923 19:43:00.138455 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:00.138459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:00.141837 (+ 3378us) server_negotiation.cc:407] Connection header received
0923 19:43:00.141887 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:00.141890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:00.141936 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:00.142077 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:00.143466 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:00.143471 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:00.143476 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:43:00.143494 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:00.143542 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:43:00.143554 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:00.143682 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:00.143876 (+ 194us) server_negotiation.cc:299] Negotiation successful
0923 19:43:00.143941 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":242,"threads_started":1}
I20260923 19:43:00.145129 23667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:00.138784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:39431 (local address 127.13.88.193:44713)
0923 19:43:00.139948 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:00.139997 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:00.141577 (+ 1580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:00.142327 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:00.142335 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:00.142426 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:00.143162 (+ 736us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:43:00.143165 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:00.143215 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:43:00.143301 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:00.143657 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:00.143668 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:00.143677 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 19:43:00.143956 (+ 279us) client_negotiation.cc:240] Negotiation successful
0923 19:43:00.144204 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":428,"threads_started":1}
I20260923 19:43:00.146726 23664 heartbeater.cc:347] Connected to a master server at 127.13.88.254:39431
I20260923 19:43:00.147032 23664 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:00.147650 23664 heartbeater.cc:511] Master 127.13.88.254:39431 requested a full tablet report, sending...
I20260923 19:43:00.149842 23478 ts_manager.cc:194] Registered new tserver with Master: fb5e87caa886458f81097113d8c9671e (127.13.88.193:41845)
W20260923 19:43:00.465904 23668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:00.466185 23668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:00.466284 23668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:00.473528 23668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:00.473627 23668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:00.473732 23668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:43:00.482679 23668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39431
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:00.484030 23668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:00.485795 23668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:00.498888 23674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:00.498888 23673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:00.499087 23676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:00.499900 23668 server_base.cc:1034] running on GCE node
I20260923 19:43:00.500433 23668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:00.501328 23668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:00.502521 23668 hybrid_clock.cc:648] HybridClock initialized: now 1790192580502487 us; error 32 us; skew 500 ppm
I20260923 19:43:00.502851 23668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:43:00.505128 23668 webserver.cc:460] Webserver started at http://127.13.88.194:36847/ using document root <none> and password file <none>
I20260923 19:43:00.505805 23668 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:00.505916 23668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:00.506259 23668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:43:00.509066 23668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "024ec360e37145028394bf5d43140d07"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "57be83a0238f26ddac5913620202e27a"
server_key_iv: "40141b4c468b616a6f04208ec0ffcde8"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.509846 23668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "024ec360e37145028394bf5d43140d07"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "57be83a0238f26ddac5913620202e27a"
server_key_iv: "40141b4c468b616a6f04208ec0ffcde8"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.514753 23668 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260923 19:43:00.518043 23682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:00.519412 23668 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:43:00.519583 23668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "024ec360e37145028394bf5d43140d07"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "57be83a0238f26ddac5913620202e27a"
server_key_iv: "40141b4c468b616a6f04208ec0ffcde8"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.519815 23668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:00.525492 23668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:00.526315 23668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:00.526590 23668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:00.527539 23668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:00.528980 23668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:00.529093 23668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:00.529247 23668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:00.529332 23668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:00.561668 23668 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:41077
I20260923 19:43:00.561726 23794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:41077 every 8 connection(s)
I20260923 19:43:00.563153 23668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:43:00.564730 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23668
I20260923 19:43:00.564908 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:43:00.565353 13667 external_mini_cluster.cc:1428] Setting key 7d94a98a09a50cf7867339482828c850
I20260923 19:43:00.568492 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39431
--builtin_ntp_servers=127.13.88.212:34787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260923 19:43:00.573067 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:00.565981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:51225 (local address 127.13.88.254:39431)
0923 19:43:00.566190 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:00.566198 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:00.568060 (+ 1862us) server_negotiation.cc:407] Connection header received
0923 19:43:00.570731 (+ 2671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:00.570736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:00.570798 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:00.570896 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:00.572422 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:00.572426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:00.572430 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:43:00.572445 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:00.572476 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:43:00.572487 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:00.572591 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:00.572812 (+ 221us) server_negotiation.cc:299] Negotiation successful
0923 19:43:00.572861 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:43:00.574397 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:00.566677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:39431 (local address 127.13.88.194:51225)
0923 19:43:00.567901 (+ 1224us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:00.567949 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:00.570429 (+ 2480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:00.571200 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:00.571213 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:00.571341 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:00.572071 (+ 730us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:43:00.572076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:00.572129 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:43:00.572243 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:00.572587 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:00.572599 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:00.572609 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 19:43:00.572891 (+ 282us) client_negotiation.cc:240] Negotiation successful
0923 19:43:00.573156 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":463,"threads_started":1}
I20260923 19:43:00.575811 23795 heartbeater.cc:347] Connected to a master server at 127.13.88.254:39431
I20260923 19:43:00.576124 23795 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:00.576865 23795 heartbeater.cc:511] Master 127.13.88.254:39431 requested a full tablet report, sending...
I20260923 19:43:00.578451 23478 ts_manager.cc:194] Registered new tserver with Master: 024ec360e37145028394bf5d43140d07 (127.13.88.194:41077)
W20260923 19:43:00.905934 23798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:00.906239 23798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:00.906384 23798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:00.914036 23798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:00.914145 23798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:00.914316 23798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:43:00.923731 23798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:34787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:39431
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:00.925274 23798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:00.927306 23798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:00.943701 23804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:00.944486 23803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:00.948925 23806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:00.953161 23798 server_base.cc:1034] running on GCE node
I20260923 19:43:00.954155 23798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:00.955611 23798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:00.956893 23798 hybrid_clock.cc:648] HybridClock initialized: now 1790192580956797 us; error 55 us; skew 500 ppm
I20260923 19:43:00.957372 23798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:43:00.963847 23798 webserver.cc:460] Webserver started at http://127.13.88.195:34129/ using document root <none> and password file <none>
I20260923 19:43:00.964917 23798 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:00.965046 23798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:00.965449 23798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:43:00.970214 23798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "42c03ac14c6443de9c8ce65f3e0b5140"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "98fd8557652258db91bc69245980726d"
server_key_iv: "48878029456b76fff4ebd4b777f40387"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.971437 23798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "42c03ac14c6443de9c8ce65f3e0b5140"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "98fd8557652258db91bc69245980726d"
server_key_iv: "48878029456b76fff4ebd4b777f40387"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.979192 23798 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260923 19:43:00.984324 23812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:00.986174 23798 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:43:00.986383 23798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "42c03ac14c6443de9c8ce65f3e0b5140"
format_stamp: "Formatted at 2026-09-23 19:43:00 on dist-test-slave-xg7f"
server_key: "98fd8557652258db91bc69245980726d"
server_key_iv: "48878029456b76fff4ebd4b777f40387"
server_key_version: "encryptionkey@0"
I20260923 19:43:00.986660 23798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:00.995611 23798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:00.996690 23798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:00.996989 23798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:00.998224 23798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:01.000298 23798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:01.000422 23798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:01.000543 23798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:01.000629 23798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:01.036307 23798 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:44539
I20260923 19:43:01.036324 23924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:44539 every 8 connection(s)
I20260923 19:43:01.038362 23798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:43:01.045452 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23798
I20260923 19:43:01.045648 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:43:01.046167 13667 external_mini_cluster.cc:1428] Setting key b2d7af7d4f0872f1bb96430e73aa5847
I20260923 19:43:01.048069 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:01.041384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:42205 (local address 127.13.88.254:39431)
0923 19:43:01.041558 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:01.041563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:01.043583 (+ 2020us) server_negotiation.cc:407] Connection header received
0923 19:43:01.045391 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:01.045400 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:01.045481 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:01.045601 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:01.047236 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:01.047242 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:01.047247 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:43:01.047266 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:01.047305 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:43:01.047317 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:01.047439 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:01.047643 (+ 204us) server_negotiation.cc:299] Negotiation successful
0923 19:43:01.047713 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:43:01.049186 23927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:01.042315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:39431 (local address 127.13.88.195:42205)
0923 19:43:01.043419 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:01.043458 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:01.045038 (+ 1580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:01.045919 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:01.045931 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:01.046056 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:01.046900 (+ 844us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:43:01.046903 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:01.046958 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:43:01.047038 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:01.047410 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:01.047420 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:01.047428 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 19:43:01.047721 (+ 293us) client_negotiation.cc:240] Negotiation successful
0923 19:43:01.047995 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":357,"threads_started":1}
I20260923 19:43:01.050532 23925 heartbeater.cc:347] Connected to a master server at 127.13.88.254:39431
I20260923 19:43:01.050835 23925 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:01.051491 23925 heartbeater.cc:511] Master 127.13.88.254:39431 requested a full tablet report, sending...
I20260923 19:43:01.052999 23478 ts_manager.cc:194] Registered new tserver with Master: 42c03ac14c6443de9c8ce65f3e0b5140 (127.13.88.195:44539)
I20260923 19:43:01.062053 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 19:43:01.068734 23666 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:43:01.066943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54284 (local address 127.13.88.254:39431)
0923 19:43:01.067182 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:01.067190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:01.067719 (+ 529us) server_negotiation.cc:407] Connection header received
0923 19:43:01.067864 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:01.067872 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:01.067948 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:01.068067 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:01.068429 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54284: BlockingRecv error: recv got EOF from 127.0.0.1:54284 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:43:01.068990 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23537
I20260923 19:43:01.073544 23934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:01.070127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56422 (local address 127.13.88.193:41845)
0923 19:43:01.070774 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:01.070787 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:01.070823 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:43:01.070904 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:01.070916 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:01.071337 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:01.071516 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:01.072637 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:01.072645 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:01.072662 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:43:01.072690 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:01.072757 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:43:01.072782 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:01.072930 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:01.073008 (+ 78us) server_negotiation.cc:299] Negotiation successful
0923 19:43:01.073116 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":301,"threads_started":1}
I20260923 19:43:01.074941 23659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:01.155290 23664 heartbeater.cc:503] Master 127.13.88.254:39431 was elected leader, sending a full tablet report...
I20260923 19:43:01.156538 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23537
W20260923 19:43:01.173573 23465 connection.cc:535] server connection from 127.13.88.193:44713 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:43:01.173887 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23668
I20260923 19:43:01.177963 23936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:01.174857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52706 (local address 127.13.88.194:41077)
0923 19:43:01.175375 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:01.175381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:01.175407 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:43:01.175494 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:01.175501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:01.175757 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:01.175926 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:01.177110 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:01.177116 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:01.177146 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:43:01.177158 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:01.177200 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:43:01.177214 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:01.177407 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:01.177540 (+ 133us) server_negotiation.cc:299] Negotiation successful
0923 19:43:01.177653 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":271,"threads_started":1}
I20260923 19:43:01.179243 23790 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:01.261276 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23668
I20260923 19:43:01.279348 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23798
I20260923 19:43:01.283008 23938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:01.280232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44172 (local address 127.13.88.195:44539)
0923 19:43:01.280856 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:01.280863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:01.280895 (+ 32us) server_negotiation.cc:407] Connection header received
0923 19:43:01.280956 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:01.280963 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:01.281177 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:01.281323 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:01.282351 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:01.282357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:01.282369 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:43:01.282380 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:01.282419 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:43:01.282433 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:01.282563 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:01.282656 (+ 93us) server_negotiation.cc:299] Negotiation successful
0923 19:43:01.282745 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":308,"threads_started":1}
I20260923 19:43:01.284302 23920 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:01.366043 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23798
I20260923 19:43:01.382016 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23447
I20260923 19:43:01.383318 23508 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:01.484983 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23447
2026-09-23T19:43:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2395 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:43:01 dist-test-slave-xg7f krb5kdc[23943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:43:01 dist-test-slave-xg7f krb5kdc[23943](info): set up 2 sockets
Sep 23 19:43:01 dist-test-slave-xg7f krb5kdc[23943](info): commencing operation
krb5kdc: starting...
W20260923 19:43:02.583986 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:43:02 dist-test-slave-xg7f krb5kdc[23943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:43:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:43:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:43:02.811998 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42169
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:42169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:43:03.134272 23956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:03.134598 23956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:03.134763 23956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:03.142036 23956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:43:03.142150 23956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:03.142254 23956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:03.142359 23956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:43:03.142448 23956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:43:03.152288 23956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:42169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:42169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:03.153644 23956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:03.154979 23956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:03.166179 23964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:03.166210 23962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:03.166468 23961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:03.166870 23956 server_base.cc:1034] running on GCE node
I20260923 19:43:03.167712 23956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:03.169083 23956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:03.170286 23956 hybrid_clock.cc:648] HybridClock initialized: now 1790192583170234 us; error 37 us; skew 500 ppm
I20260923 19:43:03.170625 23956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:03 dist-test-slave-xg7f krb5kdc[23943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192583, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:03.173720 23956 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:43:03.175287 23956 webserver.cc:460] Webserver started at http://127.13.88.254:43401/ using document root <none> and password file <none>
I20260923 19:43:03.175966 23956 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:03.176106 23956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:03.176419 23956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:43:03.179382 23956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "56da3e1b38604e38b68e3a370ab44f51"
format_stamp: "Formatted at 2026-09-23 19:43:03 on dist-test-slave-xg7f"
server_key: "aab62c5ffc65f1b504c2119541ba8e7e"
server_key_iv: "bd8b2a118cb6c3dc324e470ea5fc74d0"
server_key_version: "encryptionkey@0"
I20260923 19:43:03.180174 23956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "56da3e1b38604e38b68e3a370ab44f51"
format_stamp: "Formatted at 2026-09-23 19:43:03 on dist-test-slave-xg7f"
server_key: "aab62c5ffc65f1b504c2119541ba8e7e"
server_key_iv: "bd8b2a118cb6c3dc324e470ea5fc74d0"
server_key_version: "encryptionkey@0"
I20260923 19:43:03.185148 23956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:43:03.188514 23971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:03.189790 23956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:43:03.189971 23956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "56da3e1b38604e38b68e3a370ab44f51"
format_stamp: "Formatted at 2026-09-23 19:43:03 on dist-test-slave-xg7f"
server_key: "aab62c5ffc65f1b504c2119541ba8e7e"
server_key_iv: "bd8b2a118cb6c3dc324e470ea5fc74d0"
server_key_version: "encryptionkey@0"
I20260923 19:43:03.190171 23956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:03.207479 23956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:03.211611 23956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:03.211934 23956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:03.230736 23956 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:42169
I20260923 19:43:03.230759 24022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:42169 every 8 connection(s)
I20260923 19:43:03.232193 23956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:43:03.233820 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 23956
I20260923 19:43:03.234043 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:43:03.234812 13667 external_mini_cluster.cc:1428] Setting key 809c0675d64fdb9f2ee83bbf6b90a454
I20260923 19:43:03.236876 24023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:43:03 dist-test-slave-xg7f krb5kdc[23943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:43:03.250070 24023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51: Bootstrap starting.
I20260923 19:43:03.254411 24023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:03.255707 24023 log.cc:824] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:03.258627 24026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:03.236790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44640 (local address 127.13.88.254:42169)
0923 19:43:03.237578 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:03.237590 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:03.237630 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:43:03.239277 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:03.239299 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:03.239674 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:03.240017 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:03.241769 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:03.243023 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:03.244642 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:03.245233 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:03.245346 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:03.249954 (+ 4608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:03.249961 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:03.249977 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:03.250013 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:03.254116 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:03.254858 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:03.254868 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:03.254876 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:03.255071 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:03.255441 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:03.255447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:03.255451 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:03.256149 (+ 698us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:03.256510 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:03.256876 (+ 366us) server_negotiation.cc:299] Negotiation successful
0923 19:43:03.257265 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":373,"threads_started":1}
I20260923 19:43:03.259346 24023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51: No bootstrap required, opened a new log
I20260923 19:43:03.267323 24023 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56da3e1b38604e38b68e3a370ab44f51" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42169 } }
I20260923 19:43:03.267680 24023 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:03.267755 24023 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56da3e1b38604e38b68e3a370ab44f51, State: Initialized, Role: FOLLOWER
I20260923 19:43:03.268267 24023 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56da3e1b38604e38b68e3a370ab44f51" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42169 } }
I20260923 19:43:03.268452 24023 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:43:03.268543 24023 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:43:03.268661 24023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:03.271064 24023 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56da3e1b38604e38b68e3a370ab44f51" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42169 } }
I20260923 19:43:03.271611 24023 leader_election.cc:302] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56da3e1b38604e38b68e3a370ab44f51; no voters:
I20260923 19:43:03.272128 24023 leader_election.cc:288] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:43:03.272269 24028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:43:03.272960 24028 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [term 1 LEADER]: Becoming Leader. State: Replica: 56da3e1b38604e38b68e3a370ab44f51, State: Running, Role: LEADER
I20260923 19:43:03.273483 24028 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56da3e1b38604e38b68e3a370ab44f51" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42169 } }
I20260923 19:43:03.274251 24023 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:43:03.276491 24030 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56da3e1b38604e38b68e3a370ab44f51. Latest consensus state: current_term: 1 leader_uuid: "56da3e1b38604e38b68e3a370ab44f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56da3e1b38604e38b68e3a370ab44f51" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42169 } } }
I20260923 19:43:03.276926 24030 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [sys.catalog]: This master's current role is: LEADER
I20260923 19:43:03.277241 24029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56da3e1b38604e38b68e3a370ab44f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56da3e1b38604e38b68e3a370ab44f51" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 42169 } } }
I20260923 19:43:03.277546 24029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51 [sys.catalog]: This master's current role is: LEADER
I20260923 19:43:03.278980 24036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:43:03.284356 24036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:43:03.293223 24036 catalog_manager.cc:1347] Generated new cluster ID: a11a079f61214448bb13696ac71421f7
I20260923 19:43:03.293397 24036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:43:03.305469 24036 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:43:03.307459 24036 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:43:03.315778 24036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51: Generated new TSK 0
I20260923 19:43:03.316845 24036 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:43:03.373858 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42169
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:43:03.704493 24049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:03.704779 24049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:03.704936 24049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:03.712056 24049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:03.712164 24049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:03.712383 24049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:43:03.722085 24049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:03.723405 24049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:03.724830 24049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:03.737360 24054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:03.737413 24057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:03.737514 24055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:03.738533 24049 server_base.cc:1034] running on GCE node
I20260923 19:43:03.739168 24049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:03.740098 24049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:03.741288 24049 hybrid_clock.cc:648] HybridClock initialized: now 1790192583741229 us; error 54 us; skew 500 ppm
I20260923 19:43:03.741598 24049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:03 dist-test-slave-xg7f krb5kdc[23943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192583, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:03.744763 24049 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:43:03.746170 24049 webserver.cc:460] Webserver started at http://127.13.88.193:46541/ using document root <none> and password file <none>
I20260923 19:43:03.746841 24049 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:03.746977 24049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:03.747325 24049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:43:03.750142 24049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "fe54926991754706ad3c15bb6efa6872"
format_stamp: "Formatted at 2026-09-23 19:43:03 on dist-test-slave-xg7f"
server_key: "a0da6799bc5918fd2e4618f1ef99bfec"
server_key_iv: "ebc4a2121b4af3dd599d2c031b585334"
server_key_version: "encryptionkey@0"
I20260923 19:43:03.750905 24049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "fe54926991754706ad3c15bb6efa6872"
format_stamp: "Formatted at 2026-09-23 19:43:03 on dist-test-slave-xg7f"
server_key: "a0da6799bc5918fd2e4618f1ef99bfec"
server_key_iv: "ebc4a2121b4af3dd599d2c031b585334"
server_key_version: "encryptionkey@0"
I20260923 19:43:03.755954 24049 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:43:03.759356 24064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:03.760663 24049 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:43:03.760829 24049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "fe54926991754706ad3c15bb6efa6872"
format_stamp: "Formatted at 2026-09-23 19:43:03 on dist-test-slave-xg7f"
server_key: "a0da6799bc5918fd2e4618f1ef99bfec"
server_key_iv: "ebc4a2121b4af3dd599d2c031b585334"
server_key_version: "encryptionkey@0"
I20260923 19:43:03.761022 24049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:03.786804 24049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:03.790738 24049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:03.791041 24049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:03.792037 24049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:03.793370 24049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:03.793475 24049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:03.793628 24049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:03.793700 24049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:03.826611 24049 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:43229
I20260923 19:43:03.826642 24176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:43229 every 8 connection(s)
I20260923 19:43:03.827932 24049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:43:03.836923 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 24049
I20260923 19:43:03.837152 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:43:03.837764 13667 external_mini_cluster.cc:1428] Setting key 8af04db3967332d7046c32dbc5b395c6
Sep 23 19:43:03 dist-test-slave-xg7f krb5kdc[23943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192583, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:43:03.848985 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:03.830424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:48157 (local address 127.13.88.254:42169)
0923 19:43:03.830891 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:03.830898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:03.831921 (+ 1023us) server_negotiation.cc:407] Connection header received
0923 19:43:03.833689 (+ 1768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:03.833694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:03.833757 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:03.833855 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:03.835349 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:03.836076 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:03.837699 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:03.838151 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:03.838286 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:03.842038 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:03.842047 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:03.842054 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:03.842102 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:03.845562 (+ 3460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:03.846339 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:03.846348 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:03.846355 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:03.846515 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:03.846993 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:03.847000 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:03.847006 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:03.847446 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:03.847618 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:03.848541 (+ 923us) server_negotiation.cc:299] Negotiation successful
0923 19:43:03.848729 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":209,"threads_started":1}
I20260923 19:43:03.850622 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:03.830979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42169 (local address 127.13.88.193:48157)
0923 19:43:03.831760 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:03.831804 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:03.833421 (+ 1617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:03.834078 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:03.834085 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:03.834574 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:03.835189 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:03.835215 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:03.836195 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:03.836198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:03.837543 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:03.837555 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:03.838376 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:03.838386 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:03.838621 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:03.839402 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:43:03.839430 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:03.841803 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:03.845733 (+ 3930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:03.845740 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:03.845754 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:03.846202 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:03.846670 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:03.846673 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:03.846676 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:03.846865 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:03.847593 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:03.847599 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:03.848101 (+ 502us) client_negotiation.cc:769] Sending connection context
0923 19:43:03.848439 (+ 338us) client_negotiation.cc:240] Negotiation successful
0923 19:43:03.849106 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":316,"threads_started":1}
I20260923 19:43:03.852365 24177 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42169
I20260923 19:43:03.852725 24177 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:03.853560 24177 heartbeater.cc:511] Master 127.13.88.254:42169 requested a full tablet report, sending...
I20260923 19:43:03.856010 23988 ts_manager.cc:194] Registered new tserver with Master: fe54926991754706ad3c15bb6efa6872 (127.13.88.193:43229)
I20260923 19:43:03.858233 23988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:48157
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:43:03.891474 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42169
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:43:04.215716 24183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:04.216050 24183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:04.216220 24183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:04.223470 24183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:04.223642 24183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:04.223843 24183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:43:04.236222 24183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:04.237876 24183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:04.239527 24183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:04.254254 24188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:04.254362 24189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:04.255025 24191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:04.255738 24183 server_base.cc:1034] running on GCE node
I20260923 19:43:04.256511 24183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:04.257750 24183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:04.258967 24183 hybrid_clock.cc:648] HybridClock initialized: now 1790192584258917 us; error 61 us; skew 500 ppm
I20260923 19:43:04.259338 24183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:04 dist-test-slave-xg7f krb5kdc[23943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:04.262413 24183 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:43:04.263844 24183 webserver.cc:460] Webserver started at http://127.13.88.194:35723/ using document root <none> and password file <none>
I20260923 19:43:04.264465 24183 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:04.264593 24183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:04.264930 24183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:43:04.267896 24183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "7adc8520523b4e84bda839b40561172e"
format_stamp: "Formatted at 2026-09-23 19:43:04 on dist-test-slave-xg7f"
server_key: "d90fa19593573cd29f2951e0320dcd24"
server_key_iv: "3f94cb006bc96335cb17a7d160674881"
server_key_version: "encryptionkey@0"
I20260923 19:43:04.268630 24183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "7adc8520523b4e84bda839b40561172e"
format_stamp: "Formatted at 2026-09-23 19:43:04 on dist-test-slave-xg7f"
server_key: "d90fa19593573cd29f2951e0320dcd24"
server_key_iv: "3f94cb006bc96335cb17a7d160674881"
server_key_version: "encryptionkey@0"
I20260923 19:43:04.273617 24183 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:43:04.277149 24198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:04.278429 24183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:43:04.278615 24183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "7adc8520523b4e84bda839b40561172e"
format_stamp: "Formatted at 2026-09-23 19:43:04 on dist-test-slave-xg7f"
server_key: "d90fa19593573cd29f2951e0320dcd24"
server_key_iv: "3f94cb006bc96335cb17a7d160674881"
server_key_version: "encryptionkey@0"
I20260923 19:43:04.278844 24183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:04.300570 24183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:04.304458 24183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:04.304702 24183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:04.305579 24183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:04.306807 24183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:04.306879 24183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:04.306958 24183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:04.307000 24183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:04.339792 24183 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:33395
I20260923 19:43:04.339841 24310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:33395 every 8 connection(s)
I20260923 19:43:04.341095 24183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:43:04.342923 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 24183
I20260923 19:43:04.343183 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:43:04.343659 13667 external_mini_cluster.cc:1428] Setting key f3258bbfb97d16f8b5037bca1827e70e
Sep 23 19:43:04 dist-test-slave-xg7f krb5kdc[23943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:43:04.364591 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.343740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:42803 (local address 127.13.88.254:42169)
0923 19:43:04.343951 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.343957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.345240 (+ 1283us) server_negotiation.cc:407] Connection header received
0923 19:43:04.347805 (+ 2565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.347812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.347908 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.348008 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:04.350089 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.350787 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.353287 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.353715 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.353809 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.357529 (+ 3720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:04.357537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:04.357544 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:04.357599 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:04.361185 (+ 3586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:04.361900 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:04.361908 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:04.361914 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:04.362068 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:04.362467 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:04.362475 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:04.362481 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:04.362891 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:04.363036 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.363871 (+ 835us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.364133 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260923 19:43:04.365394 24313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.344244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42169 (local address 127.13.88.194:42803)
0923 19:43:04.345089 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:04.345131 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:04.347450 (+ 2319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:04.348363 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:04.348376 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:04.349138 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:04.349910 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.349941 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.350930 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.350937 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.353135 (+ 2198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.353153 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.353945 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.353952 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.354173 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.354890 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:43:04.354912 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:04.357297 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:04.361328 (+ 4031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:04.361334 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:04.361347 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:04.361762 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:04.362173 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:04.362176 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:04.362179 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:04.362343 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:04.363063 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:04.363073 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:04.363486 (+ 413us) client_negotiation.cc:769] Sending connection context
0923 19:43:04.363709 (+ 223us) client_negotiation.cc:240] Negotiation successful
0923 19:43:04.364150 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":337,"threads_started":1}
I20260923 19:43:04.366832 24311 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42169
I20260923 19:43:04.367202 24311 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:04.368096 24311 heartbeater.cc:511] Master 127.13.88.254:42169 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:43:04.369685 23988 ts_manager.cc:194] Registered new tserver with Master: 7adc8520523b4e84bda839b40561172e (127.13.88.194:33395)
I20260923 19:43:04.370579 23988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:42803
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:43:04.396536 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42169
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:43:04.715279 24316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:04.715576 24316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:04.715723 24316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:04.722770 24316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:04.722883 24316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:04.723067 24316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:43:04.732856 24316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:42169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:04.734208 24316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:04.735682 24316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:04.748360 24321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:04.748425 24322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:04.748402 24324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:04.749468 24316 server_base.cc:1034] running on GCE node
I20260923 19:43:04.750070 24316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:04.750962 24316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:04.752177 24316 hybrid_clock.cc:648] HybridClock initialized: now 1790192584752102 us; error 67 us; skew 500 ppm
I20260923 19:43:04.752506 24316 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:04 dist-test-slave-xg7f krb5kdc[23943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:04.755618 24316 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:43:04.757117 24316 webserver.cc:460] Webserver started at http://127.13.88.195:45087/ using document root <none> and password file <none>
I20260923 19:43:04.757833 24316 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:04.757975 24316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:04.758280 24316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:43:04.761269 24316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "eebd290665594c0c98da86d5454dbcd1"
format_stamp: "Formatted at 2026-09-23 19:43:04 on dist-test-slave-xg7f"
server_key: "8952bba64b440c0d6df1df6b6221919c"
server_key_iv: "bf734e6348c70b518247fc05836f5965"
server_key_version: "encryptionkey@0"
I20260923 19:43:04.762014 24316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "eebd290665594c0c98da86d5454dbcd1"
format_stamp: "Formatted at 2026-09-23 19:43:04 on dist-test-slave-xg7f"
server_key: "8952bba64b440c0d6df1df6b6221919c"
server_key_iv: "bf734e6348c70b518247fc05836f5965"
server_key_version: "encryptionkey@0"
I20260923 19:43:04.767575 24316 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260923 19:43:04.770895 24331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:04.772321 24316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:43:04.772491 24316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "eebd290665594c0c98da86d5454dbcd1"
format_stamp: "Formatted at 2026-09-23 19:43:04 on dist-test-slave-xg7f"
server_key: "8952bba64b440c0d6df1df6b6221919c"
server_key_iv: "bf734e6348c70b518247fc05836f5965"
server_key_version: "encryptionkey@0"
I20260923 19:43:04.772718 24316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:04.792439 24316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:04.797099 24316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:04.797400 24316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:04.798384 24316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:04.799811 24316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:04.799911 24316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:04.800064 24316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:04.800134 24316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:04.833645 24316 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:38751
I20260923 19:43:04.833681 24443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:38751 every 8 connection(s)
I20260923 19:43:04.834883 24316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:43:04.837705 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 24316
I20260923 19:43:04.837905 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:43:04.838323 13667 external_mini_cluster.cc:1428] Setting key a378918c616e262747dbf541480bbbb6
Sep 23 19:43:04 dist-test-slave-xg7f krb5kdc[23943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192584, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:43:04.854638 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.837532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:35727 (local address 127.13.88.254:42169)
0923 19:43:04.837759 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.837766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.839257 (+ 1491us) server_negotiation.cc:407] Connection header received
0923 19:43:04.841208 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.841212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.841276 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.841351 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:04.842890 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.843675 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.845071 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.845430 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.845520 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.848864 (+ 3344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:04.848869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:04.848872 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:04.848933 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:04.851614 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:04.852417 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:04.852425 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:04.852429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:04.852569 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:04.852987 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:04.852993 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:04.852996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:04.853271 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:04.853422 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.854073 (+ 651us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.854279 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:43:04.855681 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.837964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:42169 (local address 127.13.88.195:35727)
0923 19:43:04.839066 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:04.839146 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:04.840929 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:04.841559 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:04.841567 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:04.842185 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:04.842728 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.842745 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.843789 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.843793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.844946 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.844957 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.845607 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.845612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.845788 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.846379 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:43:04.846404 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:04.848651 (+ 2247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:04.851733 (+ 3082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:04.851740 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:04.851752 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:04.852299 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:04.852686 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:04.852693 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:04.852697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:04.852875 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:04.853395 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:04.853402 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:04.853729 (+ 327us) client_negotiation.cc:769] Sending connection context
0923 19:43:04.853990 (+ 261us) client_negotiation.cc:240] Negotiation successful
0923 19:43:04.854524 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":326,"threads_started":1}
I20260923 19:43:04.856971 24444 heartbeater.cc:347] Connected to a master server at 127.13.88.254:42169
I20260923 19:43:04.857270 24444 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:04.858001 24444 heartbeater.cc:511] Master 127.13.88.254:42169 requested a full tablet report, sending...
I20260923 19:43:04.859454 23988 ts_manager.cc:194] Registered new tserver with Master: eebd290665594c0c98da86d5454dbcd1 (127.13.88.195:38751)
I20260923 19:43:04.860268 23988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:35727
I20260923 19:43:04.862196 24177 heartbeater.cc:503] Master 127.13.88.254:42169 was elected leader, sending a full tablet report...
I20260923 19:43:04.866406 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:43:04.883495 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.870925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.13.88.254:42169)
0923 19:43:04.871088 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.871093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.871648 (+ 555us) server_negotiation.cc:407] Connection header received
0923 19:43:04.871785 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.871789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.871845 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.871924 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:04.873254 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.874038 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.875412 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.875877 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.876016 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.878362 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:04.878367 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:04.878370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:04.878402 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:04.880933 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:04.881583 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:04.881590 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:04.881594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:04.881740 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:04.882123 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:04.882127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:04.882129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:04.882459 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:04.882752 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.882992 (+ 240us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.883252 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:43:04.887351 23988 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:43:04.894045 23988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:43:04.914960 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.905280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:33395 (local address 127.0.0.1:54222)
0923 19:43:04.906086 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:04.906129 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:04.906293 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:04.907067 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:04.907075 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:04.907130 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:04.907616 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.907629 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.910221 (+ 2592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.910229 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.911959 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.911976 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.913819 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.913825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.914160 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.914243 (+ 83us) client_negotiation.cc:769] Sending connection context
0923 19:43:04.914362 (+ 119us) client_negotiation.cc:240] Negotiation successful
0923 19:43:04.914542 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":74,"thread_start_us":562,"threads_started":1}
I20260923 19:43:04.915741 24457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.905651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54222 (local address 127.13.88.194:33395)
0923 19:43:04.906216 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.906224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.906255 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:43:04.906549 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.906556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.906819 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.907823 (+ 1004us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:04.908125 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.910094 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.912128 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.913604 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.913766 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.913971 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.915243 (+ 1272us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.915421 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":706,"threads_started":1}
I20260923 19:43:04.916116 24458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.906593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:38751 (local address 127.0.0.1:41720)
0923 19:43:04.907067 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:04.907082 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:04.907227 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:04.908813 (+ 1586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:04.908818 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:04.908845 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:04.909303 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.909316 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.911603 (+ 2287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.911609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.913539 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.913552 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.915372 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.915378 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.915540 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.915575 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 19:43:04.915640 (+ 65us) client_negotiation.cc:240] Negotiation successful
0923 19:43:04.915784 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":234,"threads_started":1}
I20260923 19:43:04.916812 24459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.906934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41720 (local address 127.13.88.195:38751)
0923 19:43:04.908181 (+ 1247us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.908189 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.908220 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:43:04.908318 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.908327 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.908609 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.909490 (+ 881us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:04.909752 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.911451 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.913704 (+ 2253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.915159 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.916005 (+ 846us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.916259 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.916328 (+ 69us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.916490 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1063,"thread_start_us":905,"threads_started":1}
I20260923 19:43:04.917752 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.907703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52834 (local address 127.13.88.193:43229)
0923 19:43:04.908937 (+ 1234us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.908946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.908971 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:43:04.909062 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.909070 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.909303 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.910087 (+ 784us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:04.910351 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.911795 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.914372 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.915504 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.917196 (+ 1692us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.917385 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.917440 (+ 55us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.917546 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1083,"thread_start_us":907,"threads_started":1}
I20260923 19:43:04.918218 24460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.907160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43229 (local address 127.0.0.1:52834)
0923 19:43:04.908263 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:04.908278 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:04.908388 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:04.909487 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:04.909492 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:04.909513 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:04.909876 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.909888 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.911932 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.911937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.914218 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.914230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.915721 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.915725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.916813 (+ 1088us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.916844 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:43:04.916917 (+ 73us) client_negotiation.cc:240] Negotiation successful
0923 19:43:04.917884 (+ 967us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"mutex_wait_us":74,"thread_start_us":348,"threads_started":1}
I20260923 19:43:04.919600 24246 tablet_service.cc:1467] Processing CreateTablet for tablet 08c8960dfd7f4651937de38fbd8246c0 (DEFAULT_TABLE table=test-table [id=95bf222a55d94041b7a5cbd120c9113f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:43:04.920099 24379 tablet_service.cc:1467] Processing CreateTablet for tablet 08c8960dfd7f4651937de38fbd8246c0 (DEFAULT_TABLE table=test-table [id=95bf222a55d94041b7a5cbd120c9113f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:43:04.921074 24246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c8960dfd7f4651937de38fbd8246c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:43:04.921568 24379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c8960dfd7f4651937de38fbd8246c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:43:04.921597 24112 tablet_service.cc:1467] Processing CreateTablet for tablet 08c8960dfd7f4651937de38fbd8246c0 (DEFAULT_TABLE table=test-table [id=95bf222a55d94041b7a5cbd120c9113f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:43:04.922850 24112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08c8960dfd7f4651937de38fbd8246c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:43:04.932922 24462 tablet_bootstrap.cc:492] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Bootstrap starting.
I20260923 19:43:04.936321 24462 tablet_bootstrap.cc:654] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:04.937436 24462 log.cc:824] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:04.937834 24464 tablet_bootstrap.cc:492] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Bootstrap starting.
I20260923 19:43:04.939733 24463 tablet_bootstrap.cc:492] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Bootstrap starting.
I20260923 19:43:04.941169 24462 tablet_bootstrap.cc:492] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: No bootstrap required, opened a new log
I20260923 19:43:04.941452 24462 ts_tablet_manager.cc:1397] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:43:04.941725 24464 tablet_bootstrap.cc:654] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:04.943125 24463 tablet_bootstrap.cc:654] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:04.943187 24464 log.cc:824] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:04.944356 24463 log.cc:824] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:04.946972 24463 tablet_bootstrap.cc:492] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: No bootstrap required, opened a new log
I20260923 19:43:04.947270 24463 ts_tablet_manager.cc:1397] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.006s
I20260923 19:43:04.947508 24464 tablet_bootstrap.cc:492] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: No bootstrap required, opened a new log
I20260923 19:43:04.947777 24464 ts_tablet_manager.cc:1397] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260923 19:43:04.951166 24462 raft_consensus.cc:348] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:04.951653 24462 raft_consensus.cc:374] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:04.951764 24462 raft_consensus.cc:729] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eebd290665594c0c98da86d5454dbcd1, State: Initialized, Role: FOLLOWER
I20260923 19:43:04.952399 24462 consensus_queue.cc:260] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:04.953536 24444 heartbeater.cc:503] Master 127.13.88.254:42169 was elected leader, sending a full tablet report...
I20260923 19:43:04.954180 24462 ts_tablet_manager.cc:1428] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260923 19:43:04.955636 24463 raft_consensus.cc:348] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:04.955987 24463 raft_consensus.cc:374] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:04.956099 24463 raft_consensus.cc:729] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adc8520523b4e84bda839b40561172e, State: Initialized, Role: FOLLOWER
I20260923 19:43:04.956677 24463 consensus_queue.cc:260] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:04.957897 24311 heartbeater.cc:503] Master 127.13.88.254:42169 was elected leader, sending a full tablet report...
I20260923 19:43:04.958451 24463 ts_tablet_manager.cc:1428] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260923 19:43:04.958487 24464 raft_consensus.cc:348] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:04.958871 24464 raft_consensus.cc:374] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:04.958973 24464 raft_consensus.cc:729] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe54926991754706ad3c15bb6efa6872, State: Initialized, Role: FOLLOWER
I20260923 19:43:04.959560 24464 consensus_queue.cc:260] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:04.961228 24464 ts_tablet_manager.cc:1428] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260923 19:43:04.986925 24468 raft_consensus.cc:482] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:43:04.987287 24468 raft_consensus.cc:504] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:04.989060 24468 leader_election.cc:288] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adc8520523b4e84bda839b40561172e (127.13.88.194:33395), fe54926991754706ad3c15bb6efa6872 (127.13.88.193:43229)
I20260923 19:43:04.995039 24457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.989529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:59597 (local address 127.13.88.194:33395)
0923 19:43:04.989726 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.989734 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.989756 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:43:04.989827 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.989832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.989908 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.990007 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:04.990504 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.991338 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.993271 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.994115 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.994268 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.994339 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.994639 (+ 300us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.994780 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:43:04.995048 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.989272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:33395 (local address 127.13.88.195:59597)
0923 19:43:04.989473 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:04.989492 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:04.989624 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:04.990075 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:04.990079 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:04.990123 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:04.990354 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.990367 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.991475 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.991480 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.993134 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.993150 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.994253 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.994259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.994466 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.994508 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 19:43:04.994600 (+ 92us) client_negotiation.cc:240] Negotiation successful
0923 19:43:04.994733 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260923 19:43:04.996126 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c8960dfd7f4651937de38fbd8246c0" candidate_uuid: "eebd290665594c0c98da86d5454dbcd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adc8520523b4e84bda839b40561172e" is_pre_election: true
I20260923 19:43:04.996675 24266 raft_consensus.cc:2454] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eebd290665594c0c98da86d5454dbcd1 in term 0.
I20260923 19:43:04.996876 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.989841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:35549 (local address 127.13.88.193:43229)
0923 19:43:04.990032 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:04.990037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:04.991429 (+ 1392us) server_negotiation.cc:407] Connection header received
0923 19:43:04.991621 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:04.991625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:04.991681 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:04.991747 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:04.992368 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.993021 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.994897 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.995974 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.996089 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.996133 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:04.996600 (+ 467us) server_negotiation.cc:299] Negotiation successful
0923 19:43:04.996686 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:43:04.997025 24471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:04.990668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43229 (local address 127.13.88.195:35549)
0923 19:43:04.991324 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:04.991342 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:04.991475 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:04.991791 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:04.991795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:04.991820 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:04.992221 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.992232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.993164 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.993169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.994763 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:04.994774 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:04.996176 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:04.996181 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:04.996352 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:04.996386 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:43:04.996545 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 19:43:04.996661 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":1,"thread_start_us":330,"threads_started":1}
I20260923 19:43:04.997411 24332 leader_election.cc:302] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adc8520523b4e84bda839b40561172e, eebd290665594c0c98da86d5454dbcd1; no voters:
I20260923 19:43:04.997779 24468 raft_consensus.cc:2781] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:43:04.997933 24468 raft_consensus.cc:482] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:43:04.998036 24468 raft_consensus.cc:3037] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:04.998486 24132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c8960dfd7f4651937de38fbd8246c0" candidate_uuid: "eebd290665594c0c98da86d5454dbcd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe54926991754706ad3c15bb6efa6872" is_pre_election: true
I20260923 19:43:04.998960 24132 raft_consensus.cc:2454] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eebd290665594c0c98da86d5454dbcd1 in term 0.
I20260923 19:43:05.000574 24468 raft_consensus.cc:504] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:05.001171 24468 leader_election.cc:288] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [CANDIDATE]: Term 1 election: Requested vote from peers 7adc8520523b4e84bda839b40561172e (127.13.88.194:33395), fe54926991754706ad3c15bb6efa6872 (127.13.88.193:43229)
I20260923 19:43:05.001601 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c8960dfd7f4651937de38fbd8246c0" candidate_uuid: "eebd290665594c0c98da86d5454dbcd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adc8520523b4e84bda839b40561172e"
I20260923 19:43:05.001665 24132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08c8960dfd7f4651937de38fbd8246c0" candidate_uuid: "eebd290665594c0c98da86d5454dbcd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe54926991754706ad3c15bb6efa6872"
I20260923 19:43:05.001832 24132 raft_consensus.cc:3037] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:05.001833 24266 raft_consensus.cc:3037] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:05.005034 24266 raft_consensus.cc:2454] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eebd290665594c0c98da86d5454dbcd1 in term 1.
I20260923 19:43:05.005043 24132 raft_consensus.cc:2454] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eebd290665594c0c98da86d5454dbcd1 in term 1.
I20260923 19:43:05.005411 24332 leader_election.cc:302] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adc8520523b4e84bda839b40561172e, eebd290665594c0c98da86d5454dbcd1; no voters:
I20260923 19:43:05.005743 24468 raft_consensus.cc:2781] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:43:05.006176 24468 raft_consensus.cc:686] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 1 LEADER]: Becoming Leader. State: Replica: eebd290665594c0c98da86d5454dbcd1, State: Running, Role: LEADER
I20260923 19:43:05.006695 24468 consensus_queue.cc:237] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } }
I20260923 19:43:05.011660 23988 catalog_manager.cc:5495] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to eebd290665594c0c98da86d5454dbcd1 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "eebd290665594c0c98da86d5454dbcd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eebd290665594c0c98da86d5454dbcd1" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260923 19:43:05.039901 24459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:05.034600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41724 (local address 127.13.88.195:38751)
0923 19:43:05.034895 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:05.034900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:05.034913 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:43:05.034999 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:05.035003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:05.035081 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:05.035333 (+ 252us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:43:05.035693 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.036387 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.037695 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.038109 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.038241 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:05.038729 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:43:05.039322 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:43:05.039501 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:05.039560 (+ 59us) server_negotiation.cc:299] Negotiation successful
0923 19:43:05.039639 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260923 19:43:05.048062 24266 raft_consensus.cc:1261] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 1 FOLLOWER]: Refusing update from remote peer eebd290665594c0c98da86d5454dbcd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:43:05.048066 24132 raft_consensus.cc:1261] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 1 FOLLOWER]: Refusing update from remote peer eebd290665594c0c98da86d5454dbcd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:43:05.049063 24468 consensus_queue.cc:1035] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe54926991754706ad3c15bb6efa6872" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:43:05.049451 24472 consensus_queue.cc:1035] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adc8520523b4e84bda839b40561172e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:43:05.061478 24477 mvcc.cc:205] Tried to move back new op lower bound from 7332628828346064896 to 7332628828192190464. Current Snapshot: MvccSnapshot[applied={T|T < 7332628828346064896}]
I20260923 19:43:05.076610 23988 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:43:05.076906 23988 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:43:05.080549 23988 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56da3e1b38604e38b68e3a370ab44f51: Sending DeleteTablet for 3 replicas of tablet 08c8960dfd7f4651937de38fbd8246c0
I20260923 19:43:05.081621 24246 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c8960dfd7f4651937de38fbd8246c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:43:05 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:54222
I20260923 19:43:05.081737 24112 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c8960dfd7f4651937de38fbd8246c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:43:05 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:52834
I20260923 19:43:05.081787 24379 tablet_service.cc:1514] Processing DeleteTablet for tablet 08c8960dfd7f4651937de38fbd8246c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:43:05 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41720
I20260923 19:43:05.084573 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 24049
I20260923 19:43:05.095494 24487 tablet_replica.cc:330] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: stopping tablet replica
I20260923 19:43:05.096122 24487 raft_consensus.cc:2229] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:43:05.096763 24487 raft_consensus.cc:2258] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:43:05.099628 24487 ts_tablet_manager.cc:1905] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:43:05.102017 24486 tablet_replica.cc:330] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: stopping tablet replica
I20260923 19:43:05.102435 24486 raft_consensus.cc:2229] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:43:05.102927 24486 raft_consensus.cc:2258] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e [term 1 FOLLOWER]: Raft consensus is shut down!
Sep 23 19:43:05 dist-test-slave-xg7f krb5kdc[23943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:43:05.111732 24485 tablet_replica.cc:330] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: stopping tablet replica
I20260923 19:43:05.112172 24486 ts_tablet_manager.cc:1905] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:43:05.112174 24485 raft_consensus.cc:2229] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:43:05.112923 24485 raft_consensus.cc:2258] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:43:05.114899 24485 ts_tablet_manager.cc:1905] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:43:05.117005 24486 ts_tablet_manager.cc:1918] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:43:05.117190 24486 log.cc:1196] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/08c8960dfd7f4651937de38fbd8246c0
I20260923 19:43:05.117723 24486 ts_tablet_manager.cc:1939] T 08c8960dfd7f4651937de38fbd8246c0 P 7adc8520523b4e84bda839b40561172e: Deleting consensus metadata
I20260923 19:43:05.119444 24487 ts_tablet_manager.cc:1918] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:43:05.119722 24487 log.cc:1196] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/08c8960dfd7f4651937de38fbd8246c0
I20260923 19:43:05.119652 23972 catalog_manager.cc:4841] TS 7adc8520523b4e84bda839b40561172e (127.13.88.194:33395): tablet 08c8960dfd7f4651937de38fbd8246c0 (table test-table [id=95bf222a55d94041b7a5cbd120c9113f]) successfully deleted
I20260923 19:43:05.120299 24487 ts_tablet_manager.cc:1939] T 08c8960dfd7f4651937de38fbd8246c0 P fe54926991754706ad3c15bb6efa6872: Deleting consensus metadata
I20260923 19:43:05.122174 23972 catalog_manager.cc:4841] TS fe54926991754706ad3c15bb6efa6872 (127.13.88.193:43229): tablet 08c8960dfd7f4651937de38fbd8246c0 (table test-table [id=95bf222a55d94041b7a5cbd120c9113f]) successfully deleted
I20260923 19:43:05.122394 24485 ts_tablet_manager.cc:1918] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:43:05.122574 24485 log.cc:1196] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/08c8960dfd7f4651937de38fbd8246c0
I20260923 19:43:05.123195 24485 ts_tablet_manager.cc:1939] T 08c8960dfd7f4651937de38fbd8246c0 P eebd290665594c0c98da86d5454dbcd1: Deleting consensus metadata
I20260923 19:43:05.123809 24461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:05.086331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52846 (local address 127.13.88.193:43229)
0923 19:43:05.086500 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:05.086505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:05.095687 (+ 9182us) server_negotiation.cc:407] Connection header received
0923 19:43:05.095970 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:05.095979 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:05.096084 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:05.096190 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:05.098195 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.099430 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.101979 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.102629 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.102723 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:05.108468 (+ 5745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:05.108483 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:05.108503 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:05.108553 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:05.119144 (+ 10591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:05.120967 (+ 1823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:05.120976 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:05.120980 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:05.121157 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:05.121668 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:05.121674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:05.121677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:05.122182 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:05.122468 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:05.123192 (+ 724us) server_negotiation.cc:299] Negotiation successful
0923 19:43:05.123485 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:43:05.124464 24172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:05.125504 23972 catalog_manager.cc:4841] TS eebd290665594c0c98da86d5454dbcd1 (127.13.88.195:38751): tablet 08c8960dfd7f4651937de38fbd8246c0 (table test-table [id=95bf222a55d94041b7a5cbd120c9113f]) successfully deleted
I20260923 19:43:05.238948 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 24049
I20260923 19:43:05.261694 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 24183
Sep 23 19:43:05 dist-test-slave-xg7f krb5kdc[23943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:43:05.279369 24457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:05.262567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.13.88.194:33395)
0923 19:43:05.262751 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:05.262757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:05.262776 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:43:05.262970 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:05.262975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:05.263058 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:05.263198 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:05.264769 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.265817 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.267667 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.268301 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.268441 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:05.272666 (+ 4225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:05.272683 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:05.272703 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:05.272760 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:05.276564 (+ 3804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:05.277196 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:05.277206 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:05.277209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:05.277351 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:05.277676 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:05.277681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:05.277684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:05.278150 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:05.278470 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:05.278761 (+ 291us) server_negotiation.cc:299] Negotiation successful
0923 19:43:05.278974 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:43:05.280151 24306 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:05.367796 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 24183
I20260923 19:43:05.385854 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 24316
Sep 23 19:43:05 dist-test-slave-xg7f krb5kdc[23943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:43:05.402992 24459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:05.386793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41732 (local address 127.13.88.195:38751)
0923 19:43:05.386995 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:05.387002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:05.387021 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:43:05.387088 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:05.387093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:05.387236 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:05.387351 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:05.388528 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.389746 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.390907 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:05.391754 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:05.391882 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:05.396100 (+ 4218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:05.396113 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:05.396133 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:05.396178 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:05.400120 (+ 3942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:05.400744 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:05.400755 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:05.400760 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:05.400953 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:05.401335 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:05.401341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:05.401344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:05.401767 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:05.402073 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:05.402266 (+ 193us) server_negotiation.cc:299] Negotiation successful
0923 19:43:05.402492 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:43:05.403883 24439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:05.523700 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 24316
I20260923 19:43:05.543241 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 23956
I20260923 19:43:05.544397 24018 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:05.650584 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 23956
2026-09-23T19:43:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4168 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:43:05 dist-test-slave-xg7f krb5kdc[24495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:43:05 dist-test-slave-xg7f krb5kdc[24495](info): set up 2 sockets
Sep 23 19:43:05 dist-test-slave-xg7f krb5kdc[24495](info): commencing operation
krb5kdc: starting...
W20260923 19:43:06.744134 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:43:06 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:43:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:43:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/rangeradmin_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/rangeradmin_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/rangerlookup_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/rangerlookup_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
I20260923 19:43:07.054167 13667 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZLYS4k/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/postgres -l logfile start
2026-09-23 19:43:09.345 UTC [24525] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 19:43:09.345 UTC [24525] LOG: listening on IPv4 address "127.13.88.212", port 48649
2026-09-23 19:43:09.348 UTC [24525] LOG: listening on Unix socket "/tmp/.s.PGSQL.48649"
2026-09-23 19:43:09.369 UTC [24528] LOG: database system was shut down at 2026-09-23 19:43:08 UTC
2026-09-23 19:43:09.372 UTC [24525] LOG: database system is ready to accept connections
I20260923 19:43:10.343617 13667 mini_postgres.cc:96] Postgres bound to 48649
2026-09-23 19:43:10.360 UTC [24536] FATAL: database "slave" does not exist
127.13.88.212:48649 - accepting connections
I20260923 19:43:10.360821 13667 mini_ranger.cc:161] Starting Ranger...
I20260923 19:43:10.385022 13667 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 19:43:10.788267 13667 mini_ranger.cc:87] Created ranger Postgres database
I20260923 19:43:10.788411 13667 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-admin
2026-09-23 19:43:11,065 [I] DB FLAVOR :POSTGRES
2026-09-23 19:43:11,065 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:43:11,065 [I] Checking connection..
2026-09-23 19:43:11,066 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 19:43:11,299 [I] Checking connection passed.
2026-09-23 19:43:11,299 [I] --------- Verifying version history table ---------
2026-09-23 19:43:11,299 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:43:11,551 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:43:11,552 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:43:11,785 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:43:11,785 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 19:43:11,785 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 19:43:12.033 UTC [24600] WARNING: there is no transaction in progress
2026-09-23 19:43:12,039 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 19:43:12,040 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:43:12,276 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 19:43:12,276 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:43:12,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 19:43:12,535 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 19:43:12,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-xg7f.c.gcp-upstream.internal','N') ;"
2026-09-23 19:43:13,018 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:43:13,262 [I] Table x_portal_user does not exist in database ranger
2026-09-23 19:43:13,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:43:13,489 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 19:43:13,490 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:43:13,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:43:13,986 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 19:43:13,986 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 19:43:14.889 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:14.905 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:14.920 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:14.935 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:14.950 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:14.967 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.030 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.037 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.050 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.060 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.069 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.081 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.090 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.096 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.102 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15.108 UTC [24708] WARNING: there is no transaction in progress
2026-09-23 19:43:15,693 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 19:43:15,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 19:43:15,930 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 19:43:15,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:43:16,161 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 19:43:16,161 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:43:16,411 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 19:43:16,411 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:43:16,664 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:43:16,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-xg7f.c.gcp-upstream.internal';"
2026-09-23 19:43:17,148 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 19:43:17,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 19:43:17,388 [I] DB_PATCHES have already been applied
I20260923 19:43:17.394075 13667 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZLYS4k/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 19:43:17.394155 13667 mini_ranger.cc:193] Using host: 127.13.88.212
I20260923 19:43:17.407949 13667 mini_ranger.cc:227] Ranger admin URL: http://127.13.88.212:34999
Sep 23, 2026 7:43:17 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:43:17 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:43:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 7:43:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 7:43:17 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 7:43:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 7:43:18 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 19:43:18.514892 13667 mini_ranger.cc:160] Time spent starting Ranger: real 8.154s user 0.001s sys 0.034s
Sep 23, 2026 7:43:37 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 7:43:37 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 23, 2026 7:43:37 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 7:43:37 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 7:43:38 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 19:43:39.054049 13667 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/rangerkms_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/rangerkms_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.88.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.88.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 19:43:39 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192619, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 19:43:39.234599 13667 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 19:43:39.255448 13667 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 19:43:40.006597 13667 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 19:43:40.006788 13667 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms
I20260923 19:43:40.006909 13667 mini_ranger_kms.cc:227] Using postgres at 127.13.88.212:48649
2026-09-23 19:43:40,429 [I] DB FLAVOR :POSTGRES
2026-09-23 19:43:40,429 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:43:40,429 [I] Checking connection
2026-09-23 19:43:40,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 19:43:40,661 [I] connection success
2026-09-23 19:43:40,662 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 19:43:40,662 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 19:43:40,662 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 19:43:40,913 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 19:43:40,913 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:43:40,914 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 19:43:40,914 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:48649/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 19:43:41,183 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 19:43:41.636487 13667 mini_ranger_kms.cc:310] Created kms service
I20260923 19:43:41.844470 13667 mini_ranger_kms.cc:326] Created kudu user
I20260923 19:43:41.888743 13667 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 19:43:41 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192619, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:43:42.283715 13667 mini_ranger_kms.cc:384] Added ranger policy
I20260923 19:43:42.284029 13667 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 19:43:42.284075 13667 mini_ranger_kms.cc:240] Using host: 127.13.88.212
I20260923 19:43:42.305305 13667 mini_ranger_kms.cc:276] Ranger KMS PID: 24888
I20260923 19:43:42.305508 13667 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.88.212:53355
Sep 23, 2026 7:43:43 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:43:43 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:43:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 7:43:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 7:43:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 7:43:43 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Sep 23 19:43:44 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192624, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.88.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:44.603794 13667 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.369s user 0.124s sys 0.312s
I20260923 19:43:44.604028 13667 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 19:43:44.604233 13667 mini_ranger_kms.cc:401] 127.13.88.212:53355/kms/v1/keys
Sep 23 19:43:44 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192624, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.88.212@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
Sep 23 19:43:45 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192624, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.88.212@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
Sep 23 19:43:47 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:43:47.346364 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38449
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:38449
--ranger_config_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:53355/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:43:47.677722 24939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:47.678031 24939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:47.678198 24939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:47.685436 24939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:43:47.685587 24939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:47.685691 24939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:47.685792 24939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:43:47.685880 24939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:43:47.695920 24939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.88.212:53355/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:38449
--ranger_config_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:47.697158 24939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:47.698523 24939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:47.709748 24944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:47.709808 24947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:47.709983 24945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:47.710829 24939 server_base.cc:1034] running on GCE node
I20260923 19:43:47.711571 24939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:47.712875 24939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:47.714092 24939 hybrid_clock.cc:648] HybridClock initialized: now 1790192627714009 us; error 96 us; skew 500 ppm
I20260923 19:43:47.714416 24939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:47 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192627, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:47.720022 24939 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:43:47.721521 24939 webserver.cc:460] Webserver started at http://127.13.88.254:32905/ using document root <none> and password file <none>
I20260923 19:43:47.722105 24939 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:47.722198 24939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:47.722438 24939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:43:47 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192627, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:43:47.773679 24939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "f3e60e76636f49549c1a4de18fd97565"
format_stamp: "Formatted at 2026-09-23 19:43:47 on dist-test-slave-xg7f"
server_key: "6e8039350ade70474f22477bc6d7d9a0"
server_key_iv: "e6964be2c3b7d147e3d31c95cf1ab4f2"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:47.774507 24939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "f3e60e76636f49549c1a4de18fd97565"
format_stamp: "Formatted at 2026-09-23 19:43:47 on dist-test-slave-xg7f"
server_key: "6e8039350ade70474f22477bc6d7d9a0"
server_key_iv: "e6964be2c3b7d147e3d31c95cf1ab4f2"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:47.779826 24939 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260923 19:43:47.795526 24954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:47.797130 24939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:43:47.797315 24939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "f3e60e76636f49549c1a4de18fd97565"
format_stamp: "Formatted at 2026-09-23 19:43:47 on dist-test-slave-xg7f"
server_key: "6e8039350ade70474f22477bc6d7d9a0"
server_key_iv: "e6964be2c3b7d147e3d31c95cf1ab4f2"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:47.797537 24939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:47.827306 24939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:47.831409 24939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:47.831745 24939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:47.850824 24939 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:38449
I20260923 19:43:47.850908 25005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:38449 every 8 connection(s)
I20260923 19:43:47.852202 24939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:43:47.855794 25006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:43:47.861275 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 24939
I20260923 19:43:47.861474 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:43:47.862301 13667 external_mini_cluster.cc:1428] Setting key 44aa131f20f45a6d65086d51ecfdf38a
I20260923 19:43:47.866890 25006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565: Bootstrap starting.
I20260923 19:43:47.869802 25006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:47.870769 25006 log.cc:824] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:47.873386 25006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565: No bootstrap required, opened a new log
Sep 23 19:43:47 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:43:47.880673 25006 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e60e76636f49549c1a4de18fd97565" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38449 } }
I20260923 19:43:47.881052 25006 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:47.881177 25006 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3e60e76636f49549c1a4de18fd97565, State: Initialized, Role: FOLLOWER
I20260923 19:43:47.881771 25006 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e60e76636f49549c1a4de18fd97565" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38449 } }
I20260923 19:43:47.882012 25006 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:43:47.882153 25006 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:43:47.882411 25006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:47.883469 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:47.864473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41142 (local address 127.13.88.254:38449)
0923 19:43:47.865266 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:47.865277 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:47.865312 (+ 35us) server_negotiation.cc:407] Connection header received
0923 19:43:47.866879 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:47.866900 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:47.867387 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:47.867741 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:47.869007 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:47.870365 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:47.871722 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:47.872369 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:47.872568 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:47.876281 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:47.876288 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:47.876306 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:47.876347 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:47.879412 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:47.880128 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:47.880134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:47.880140 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:47.880267 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:47.880629 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:47.880636 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:47.880639 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:47.881265 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:47.881584 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:47.882015 (+ 431us) server_negotiation.cc:299] Negotiation successful
0923 19:43:47.882402 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":362,"threads_started":1}
I20260923 19:43:47.884919 25006 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e60e76636f49549c1a4de18fd97565" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38449 } }
I20260923 19:43:47.885442 25006 leader_election.cc:302] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3e60e76636f49549c1a4de18fd97565; no voters:
I20260923 19:43:47.886027 25006 leader_election.cc:288] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:43:47.886121 25011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:43:47.887089 25011 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [term 1 LEADER]: Becoming Leader. State: Replica: f3e60e76636f49549c1a4de18fd97565, State: Running, Role: LEADER
I20260923 19:43:47.887646 25011 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e60e76636f49549c1a4de18fd97565" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38449 } }
I20260923 19:43:47.888015 25006 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:43:47.890379 25013 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3e60e76636f49549c1a4de18fd97565. Latest consensus state: current_term: 1 leader_uuid: "f3e60e76636f49549c1a4de18fd97565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e60e76636f49549c1a4de18fd97565" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38449 } } }
I20260923 19:43:47.890750 25013 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [sys.catalog]: This master's current role is: LEADER
I20260923 19:43:47.891559 25012 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3e60e76636f49549c1a4de18fd97565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3e60e76636f49549c1a4de18fd97565" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38449 } } }
I20260923 19:43:47.892096 25012 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565 [sys.catalog]: This master's current role is: LEADER
I20260923 19:43:47.895690 25019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:43:47.900874 25019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:43:47.901432 25006 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 19:43:47.919956 25019 catalog_manager.cc:1347] Generated new cluster ID: 3ff8b897efc2408592ef84aae70c5699
I20260923 19:43:47.920123 25019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:43:47.931710 25019 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:43:47.932991 25019 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:43:47.940440 25019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565: Generated new TSK 0
I20260923 19:43:47.941252 25019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:43:48.658910 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:53355/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38449
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:43:49 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260923 19:43:49.086508 25051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:49.086834 25051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:49.087013 25051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:49.095330 25051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:49.095463 25051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:49.095645 25051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:43:49.106876 25051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.88.212:53355/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:49.108515 25051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:49.109952 25051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:49.126871 25061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:49.127868 25062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:49.132201 25065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:49.133292 25051 server_base.cc:1034] running on GCE node
I20260923 19:43:49.133972 25051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:49.135090 25051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:49.136404 25051 hybrid_clock.cc:648] HybridClock initialized: now 1790192629136337 us; error 58 us; skew 500 ppm
I20260923 19:43:49.136726 25051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:49 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:49.140000 25051 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:43:49.144804 25051 webserver.cc:460] Webserver started at http://127.13.88.193:46501/ using document root <none> and password file <none>
I20260923 19:43:49.145526 25051 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:49.145668 25051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:49.146056 25051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:43:49 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:43:49.162303 25051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f"
format_stamp: "Formatted at 2026-09-23 19:43:49 on dist-test-slave-xg7f"
server_key: "a5c29995c579777f894d631f59a954dd"
server_key_iv: "61561aad0ed55b5ab299ae44469f0464"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:49.163525 25051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f"
format_stamp: "Formatted at 2026-09-23 19:43:49 on dist-test-slave-xg7f"
server_key: "a5c29995c579777f894d631f59a954dd"
server_key_iv: "61561aad0ed55b5ab299ae44469f0464"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:49.190727 25051 fs_manager.cc:691] Time spent creating directory manager: real 0.027s user 0.013s sys 0.012s
I20260923 19:43:49.215723 25071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:49.220600 25051 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.006s sys 0.004s
I20260923 19:43:49.220806 25051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f"
format_stamp: "Formatted at 2026-09-23 19:43:49 on dist-test-slave-xg7f"
server_key: "a5c29995c579777f894d631f59a954dd"
server_key_iv: "61561aad0ed55b5ab299ae44469f0464"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:49.221271 25051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:49.295351 25051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:49.300174 25051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:49.300501 25051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:49.301642 25051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:49.303364 25051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:49.303465 25051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:49.303583 25051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:49.303645 25051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:49.367638 25051 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:39565
I20260923 19:43:49.367688 25183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:39565 every 8 connection(s)
I20260923 19:43:49.369397 25051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:43:49.370499 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 25051
I20260923 19:43:49.370712 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:43:49.371619 13667 external_mini_cluster.cc:1428] Setting key 8fe8b3bfef535d55a367493573837ef7
Sep 23 19:43:49 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:43:49.409783 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:49.374617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:59543 (local address 127.13.88.254:38449)
0923 19:43:49.384155 (+ 9538us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:49.384164 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:49.384187 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:43:49.384261 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:49.384269 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:49.384379 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:49.384523 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:49.388923 (+ 4400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:49.389907 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:49.394058 (+ 4151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:49.395517 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:49.395662 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:49.401178 (+ 5516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:49.401216 (+ 38us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:49.401222 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:49.401264 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:49.406184 (+ 4920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:49.407059 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:49.407065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:49.407069 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:49.407232 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:49.407801 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:49.407807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:49.407810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:49.408176 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:49.408327 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:49.409178 (+ 851us) server_negotiation.cc:299] Negotiation successful
0923 19:43:49.409405 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9367,"thread_start_us":9247,"threads_started":1}
I20260923 19:43:49.411064 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:49.373249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38449 (local address 127.13.88.193:59543)
0923 19:43:49.379880 (+ 6631us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:49.379947 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:49.383282 (+ 3335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:49.387012 (+ 3730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:49.387025 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:49.387701 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:49.388640 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:49.388668 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:49.390394 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:49.390400 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:49.393838 (+ 3438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:49.393862 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:49.396032 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:49.396040 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:49.396379 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:49.397322 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:43:49.397353 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:49.400856 (+ 3503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:49.406352 (+ 5496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:49.406362 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:49.406382 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:49.406903 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:49.407371 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:49.407376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:49.407379 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:49.407654 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:49.408418 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:49.408440 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:49.408802 (+ 362us) client_negotiation.cc:769] Sending connection context
0923 19:43:49.409091 (+ 289us) client_negotiation.cc:240] Negotiation successful
0923 19:43:49.409652 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6221,"thread_start_us":5957,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
I20260923 19:43:49.413025 25184 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38449
I20260923 19:43:49.413341 25184 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:49.414215 25184 heartbeater.cc:511] Master 127.13.88.254:38449 requested a full tablet report, sending...
I20260923 19:43:49.416810 24971 ts_manager.cc:194] Registered new tserver with Master: e0a7f1b017a64c7a8bdcbcde7aaa0d1f (127.13.88.193:39565)
I20260923 19:43:49.419013 24971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:59543
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:43:49.448069 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:53355/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38449
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:43:49 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
Sep 23 19:43:49 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
W20260923 19:43:49.855795 25190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:49.856287 25190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:49.856482 25190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:49.867482 25190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:49.867686 25190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:49.867916 25190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:43:49.882987 25190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.88.212:53355/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:49.884884 25190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:49.886726 25190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:49.946857 25198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:49.949386 25197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:49.949922 25201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:49.950372 25190 server_base.cc:1034] running on GCE node
I20260923 19:43:49.951318 25190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:49.955928 25190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:49.957223 25190 hybrid_clock.cc:648] HybridClock initialized: now 1790192629957120 us; error 100 us; skew 500 ppm
I20260923 19:43:49.957665 25190 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:49 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:49.966266 25190 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:43:50.015129 25190 webserver.cc:460] Webserver started at http://127.13.88.194:38611/ using document root <none> and password file <none>
I20260923 19:43:50.016321 25190 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:50.016570 25190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:50.017015 25190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:43:50 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:43:50.052829 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "bbe81b33b75b42f0856bc17f8b966d0e"
format_stamp: "Formatted at 2026-09-23 19:43:50 on dist-test-slave-xg7f"
server_key: "833b79b2841c8d24b3986c85dda535ef"
server_key_iv: "05fedf0f31046139eb51168e2164c533"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:50.054752 25190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "bbe81b33b75b42f0856bc17f8b966d0e"
format_stamp: "Formatted at 2026-09-23 19:43:50 on dist-test-slave-xg7f"
server_key: "833b79b2841c8d24b3986c85dda535ef"
server_key_iv: "05fedf0f31046139eb51168e2164c533"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:50.069097 25190 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.005s sys 0.006s
I20260923 19:43:50.110445 25207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:50.112443 25190 fs_manager.cc:725] Time spent opening block manager: real 0.022s user 0.006s sys 0.007s
I20260923 19:43:50.112735 25190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "bbe81b33b75b42f0856bc17f8b966d0e"
format_stamp: "Formatted at 2026-09-23 19:43:50 on dist-test-slave-xg7f"
server_key: "833b79b2841c8d24b3986c85dda535ef"
server_key_iv: "05fedf0f31046139eb51168e2164c533"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:50.113058 25190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:50.188822 25190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:50.194049 25190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:50.194370 25190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:50.195573 25190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:50.197407 25190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:50.197511 25190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:50.197691 25190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:50.197765 25190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:50.238575 25190 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:33409
I20260923 19:43:50.238596 25326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:33409 every 8 connection(s)
I20260923 19:43:50.240324 25190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:43:50.244469 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 25190
I20260923 19:43:50.244635 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:43:50.245163 13667 external_mini_cluster.cc:1428] Setting key a9115398ae36a70e99b246aff78f1fc5
Sep 23 19:43:50 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192629, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
I20260923 19:43:50.284240 25329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:50.243235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:54317 (local address 127.13.88.254:38449)
0923 19:43:50.257563 (+ 14328us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:50.257570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:50.262317 (+ 4747us) server_negotiation.cc:407] Connection header received
0923 19:43:50.264984 (+ 2667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:50.264991 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:50.265087 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:50.265169 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:50.267398 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.268586 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.270965 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.271632 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.271729 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:50.276233 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:50.276240 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:50.276245 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:50.276285 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:50.279688 (+ 3403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:50.280610 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:50.280616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:50.280619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:50.280754 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:50.281279 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:50.281284 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:50.281288 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:50.281628 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:50.281767 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:50.283626 (+ 1859us) server_negotiation.cc:299] Negotiation successful
0923 19:43:50.283848 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14171,"thread_start_us":14313,"threads_started":1}
I20260923 19:43:50.286782 25330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:50.243766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38449 (local address 127.13.88.194:54317)
0923 19:43:50.262101 (+ 18335us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:50.262183 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:50.264643 (+ 2460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:50.265745 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:50.265757 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:50.266358 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:50.267201 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:50.267227 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.268786 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.268791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:50.270798 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:50.270818 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.272098 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.272105 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:50.272383 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:50.273164 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:43:50.273191 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:50.275994 (+ 2803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:50.279864 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:50.279873 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:50.279890 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:50.280427 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:50.280899 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:50.280904 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:50.280908 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:50.281138 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:50.281824 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:50.281833 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:50.282215 (+ 382us) client_negotiation.cc:769] Sending connection context
0923 19:43:50.284805 (+ 2590us) client_negotiation.cc:240] Negotiation successful
0923 19:43:50.285346 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18018,"thread_start_us":17806,"threads_started":1}
I20260923 19:43:50.288684 25327 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38449
I20260923 19:43:50.289037 25327 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:50.289862 25327 heartbeater.cc:511] Master 127.13.88.254:38449 requested a full tablet report, sending...
I20260923 19:43:50.291579 24971 ts_manager.cc:194] Registered new tserver with Master: bbe81b33b75b42f0856bc17f8b966d0e (127.13.88.194:33409)
I20260923 19:43:50.292690 24971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:54317
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:43:50.316841 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:53355/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38449
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:43:50.426332 25184 heartbeater.cc:503] Master 127.13.88.254:38449 was elected leader, sending a full tablet report...
W20260923 19:43:50.759959 25333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:43:50.760222 25333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:43:50.760354 25333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:43:50.767506 25333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:43:50.767611 25333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:43:50.767784 25333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:43:50.777621 25333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.88.212:53355/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:43:50.778891 25333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:43:50.780229 25333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:43:50.792845 25338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:50.792845 25339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:43:50.793650 25341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:43:50.793982 25333 server_base.cc:1034] running on GCE node
I20260923 19:43:50.794569 25333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:43:50.795558 25333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:43:50.796748 25333 hybrid_clock.cc:648] HybridClock initialized: now 1790192630796699 us; error 39 us; skew 500 ppm
I20260923 19:43:50.797070 25333 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:43:50 dist-test-slave-xg7f krb5kdc[24495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192630, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:43:50.800132 25333 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:43:50.801613 25333 webserver.cc:460] Webserver started at http://127.13.88.195:37485/ using document root <none> and password file <none>
I20260923 19:43:50.802266 25333 fs_manager.cc:359] Metadata directory not provided
I20260923 19:43:50.802404 25333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:43:50.802716 25333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:43:50 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192630, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:43:50.819448 25333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "521fbf2c4ac4415eb8ff3fed88240c58"
format_stamp: "Formatted at 2026-09-23 19:43:50 on dist-test-slave-xg7f"
server_key: "83257609ebc01f7895ddcdb8d67ec0ae"
server_key_iv: "49cd5478e69eb6b4ded19837a83ee778"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:50.820540 25333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "521fbf2c4ac4415eb8ff3fed88240c58"
format_stamp: "Formatted at 2026-09-23 19:43:50 on dist-test-slave-xg7f"
server_key: "83257609ebc01f7895ddcdb8d67ec0ae"
server_key_iv: "49cd5478e69eb6b4ded19837a83ee778"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:50.827133 25333 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260923 19:43:50.844496 25348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:50.846499 25333 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260923 19:43:50.846699 25333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "521fbf2c4ac4415eb8ff3fed88240c58"
format_stamp: "Formatted at 2026-09-23 19:43:50 on dist-test-slave-xg7f"
server_key: "83257609ebc01f7895ddcdb8d67ec0ae"
server_key_iv: "49cd5478e69eb6b4ded19837a83ee778"
server_key_version: "kuduclusterkey@0"
I20260923 19:43:50.846932 25333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:43:50.867822 25333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:43:50.871860 25333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:43:50.872160 25333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:43:50.873183 25333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:43:50.874645 25333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:43:50.874743 25333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:50.874894 25333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:43:50.874963 25333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:43:50.921399 25333 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:37347
I20260923 19:43:50.921401 25460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:37347 every 8 connection(s)
I20260923 19:43:50.922816 25333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:43:50.932232 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 25333
I20260923 19:43:50.932404 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:43:50.932924 13667 external_mini_cluster.cc:1428] Setting key a90f5c23c1ea3552bff7e792fc54ea84
Sep 23 19:43:50 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192630, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:43:50.947011 25463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:50.925820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:43015 (local address 127.13.88.254:38449)
0923 19:43:50.926362 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:50.926368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:50.927423 (+ 1055us) server_negotiation.cc:407] Connection header received
0923 19:43:50.929926 (+ 2503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:50.929931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:50.929997 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:50.930099 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:50.931987 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.933103 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.935418 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.936025 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.936120 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:50.940447 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:50.940455 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:50.940460 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:50.940502 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:50.943818 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:50.944575 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:50.944581 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:50.944585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:50.944746 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:50.945192 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:50.945197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:50.945200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:50.945557 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:50.945701 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:50.946383 (+ 682us) server_negotiation.cc:299] Negotiation successful
0923 19:43:50.946613 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":270,"threads_started":1}
I20260923 19:43:50.948263 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:50.926362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38449 (local address 127.13.88.195:43015)
0923 19:43:50.927225 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:50.927302 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:50.929621 (+ 2319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:50.930373 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:50.930383 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:50.930949 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:43:50.931798 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:50.931823 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.933265 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.933271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:50.935266 (+ 1995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:50.935281 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.936242 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.936249 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:50.936521 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:50.937687 (+ 1166us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:43:50.937717 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:43:50.940166 (+ 2449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:43:50.943962 (+ 3796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:50.943969 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:50.943983 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:50.944428 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:50.944858 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:43:50.944861 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:43:50.944863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:43:50.945057 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:43:50.945673 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:43:50.945678 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:43:50.946003 (+ 325us) client_negotiation.cc:769] Sending connection context
0923 19:43:50.946288 (+ 285us) client_negotiation.cc:240] Negotiation successful
0923 19:43:50.946822 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":304,"threads_started":1}
I20260923 19:43:50.949862 25461 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38449
I20260923 19:43:50.950181 25461 heartbeater.cc:464] Registering TS with master...
I20260923 19:43:50.950913 25461 heartbeater.cc:511] Master 127.13.88.254:38449 requested a full tablet report, sending...
I20260923 19:43:50.952490 24971 ts_manager.cc:194] Registered new tserver with Master: 521fbf2c4ac4415eb8ff3fed88240c58 (127.13.88.195:37347)
I20260923 19:43:50.953584 24971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:43015
I20260923 19:43:50.961366 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:43:50.980288 25463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:50.966055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41148 (local address 127.13.88.254:38449)
0923 19:43:50.966249 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:50.966255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:50.966698 (+ 443us) server_negotiation.cc:407] Connection header received
0923 19:43:50.966829 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:50.966834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:50.966951 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:50.967062 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:50.968800 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.969949 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.971319 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:50.971960 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:50.972096 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:50.974477 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:50.974483 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:50.974488 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:50.974529 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:50.977776 (+ 3247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:50.978417 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:50.978422 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:50.978426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:50.978570 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:50.978918 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:50.978922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:50.978925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:50.979276 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:50.979493 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:50.979768 (+ 275us) server_negotiation.cc:299] Negotiation successful
0923 19:43:50.979979 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:43:50.984598 24971 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:43:50.994706 24971 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:43:51.037459 25476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.011204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:33409 (local address 127.0.0.1:44404)
0923 19:43:51.028100 (+ 16896us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:51.028118 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:51.028247 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:51.028986 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:51.028994 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:51.029024 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:51.029413 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.029424 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.031247 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.031252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.034110 (+ 2858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.034125 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.036388 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.036396 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.036603 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.036654 (+ 51us) client_negotiation.cc:769] Sending connection context
0923 19:43:51.036802 (+ 148us) client_negotiation.cc:240] Negotiation successful
0923 19:43:51.037043 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16760,"thread_start_us":16615,"threads_started":1}
I20260923 19:43:51.038401 25477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.011466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44404 (local address 127.13.88.194:33409)
0923 19:43:51.027427 (+ 15961us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.027437 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.028251 (+ 814us) server_negotiation.cc:407] Connection header received
0923 19:43:51.028392 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.028403 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.028711 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.028912 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:51.029613 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.031054 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.034576 (+ 3522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.035886 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.036009 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.036232 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.037882 (+ 1650us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.038062 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15798,"thread_start_us":15962,"threads_started":1}
I20260923 19:43:51.038674 25474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.008604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:39565 (local address 127.0.0.1:34076)
0923 19:43:51.024001 (+ 15397us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:51.024057 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:51.024314 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:51.029529 (+ 5215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:51.029534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:51.029557 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:51.030008 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.030025 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.033992 (+ 3967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.033999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.036192 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.036206 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.037986 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.037992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.038179 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.038208 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:43:51.038266 (+ 58us) client_negotiation.cc:240] Negotiation successful
0923 19:43:51.038376 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15033,"thread_start_us":15903,"threads_started":1}
I20260923 19:43:51.039544 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.009027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34076 (local address 127.13.88.193:39565)
0923 19:43:51.022277 (+ 13250us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.022286 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.028958 (+ 6672us) server_negotiation.cc:407] Connection header received
0923 19:43:51.029071 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.029090 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.029349 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.029545 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:51.031647 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.033799 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.036382 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.037756 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.038784 (+ 1028us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.039000 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.039092 (+ 92us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.039262 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13045,"thread_start_us":13256,"threads_started":1}
I20260923 19:43:51.043244 25119 tablet_service.cc:1467] Processing CreateTablet for tablet 15017acea83f42ae8b09d63e0d17e5b2 (DEFAULT_TABLE table=test-table [id=1cb458d3d3f64949a5436bbaf542b12e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:43:51.043184 25262 tablet_service.cc:1467] Processing CreateTablet for tablet 15017acea83f42ae8b09d63e0d17e5b2 (DEFAULT_TABLE table=test-table [id=1cb458d3d3f64949a5436bbaf542b12e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:43:51.044669 25262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15017acea83f42ae8b09d63e0d17e5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:43:51.044667 25119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15017acea83f42ae8b09d63e0d17e5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:43:51.049917 25479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.028773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37347 (local address 127.0.0.1:45956)
0923 19:43:51.035418 (+ 6645us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:51.035436 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:51.035643 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:51.036611 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:51.036615 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:51.036637 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:51.037054 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.037082 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.044573 (+ 7491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.044579 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.046802 (+ 2223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.046819 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.048995 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.049004 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.049206 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.049254 (+ 48us) client_negotiation.cc:769] Sending connection context
0923 19:43:51.049360 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 19:43:51.049538 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6506,"mutex_wait_us":26,"thread_start_us":5577,"threads_started":1}
I20260923 19:43:51.050661 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.025666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45956 (local address 127.13.88.195:37347)
0923 19:43:51.028863 (+ 3197us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.028871 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.035531 (+ 6660us) server_negotiation.cc:407] Connection header received
0923 19:43:51.035860 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.035867 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.036131 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.036295 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:51.037291 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.041311 (+ 4020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.047010 (+ 5699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.048494 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.048591 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.048819 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.050302 (+ 1483us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.050421 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2946,"thread_start_us":2784,"threads_started":1}
I20260923 19:43:51.054539 25396 tablet_service.cc:1467] Processing CreateTablet for tablet 15017acea83f42ae8b09d63e0d17e5b2 (DEFAULT_TABLE table=test-table [id=1cb458d3d3f64949a5436bbaf542b12e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:43:51.055919 25396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15017acea83f42ae8b09d63e0d17e5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:43:51.075888 25480 tablet_bootstrap.cc:492] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Bootstrap starting.
I20260923 19:43:51.076486 25481 tablet_bootstrap.cc:492] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Bootstrap starting.
I20260923 19:43:51.077881 25482 tablet_bootstrap.cc:492] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Bootstrap starting.
I20260923 19:43:51.079651 25481 tablet_bootstrap.cc:654] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:51.079667 25480 tablet_bootstrap.cc:654] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:51.081174 25481 log.cc:824] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:51.081180 25480 log.cc:824] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:51.081423 25482 tablet_bootstrap.cc:654] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Neither blocks nor log segments found. Creating new log.
I20260923 19:43:51.082773 25482 log.cc:824] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Log is configured to *not* fsync() on all Append() calls
I20260923 19:43:51.087863 25480 tablet_bootstrap.cc:492] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: No bootstrap required, opened a new log
I20260923 19:43:51.088189 25480 ts_tablet_manager.cc:1397] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260923 19:43:51.091922 25482 tablet_bootstrap.cc:492] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: No bootstrap required, opened a new log
I20260923 19:43:51.092191 25482 ts_tablet_manager.cc:1397] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260923 19:43:51.097810 25481 tablet_bootstrap.cc:492] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: No bootstrap required, opened a new log
I20260923 19:43:51.098073 25481 ts_tablet_manager.cc:1397] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.007s
I20260923 19:43:51.100107 25480 raft_consensus.cc:348] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.100565 25480 raft_consensus.cc:374] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:51.100675 25480 raft_consensus.cc:729] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0a7f1b017a64c7a8bdcbcde7aaa0d1f, State: Initialized, Role: FOLLOWER
I20260923 19:43:51.101373 25480 consensus_queue.cc:260] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.103428 25482 raft_consensus.cc:348] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.103955 25482 raft_consensus.cc:374] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:51.104081 25482 raft_consensus.cc:729] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521fbf2c4ac4415eb8ff3fed88240c58, State: Initialized, Role: FOLLOWER
I20260923 19:43:51.104797 25482 consensus_queue.cc:260] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.109872 25480 ts_tablet_manager.cc:1428] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Time spent starting tablet: real 0.022s user 0.008s sys 0.012s
I20260923 19:43:51.110286 25481 raft_consensus.cc:348] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.110702 25481 raft_consensus.cc:374] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:43:51.110800 25481 raft_consensus.cc:729] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe81b33b75b42f0856bc17f8b966d0e, State: Initialized, Role: FOLLOWER
I20260923 19:43:51.111512 25481 consensus_queue.cc:260] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.112771 25327 heartbeater.cc:503] Master 127.13.88.254:38449 was elected leader, sending a full tablet report...
I20260923 19:43:51.112856 25482 ts_tablet_manager.cc:1428] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Time spent starting tablet: real 0.021s user 0.014s sys 0.006s
I20260923 19:43:51.113173 25461 heartbeater.cc:503] Master 127.13.88.254:38449 was elected leader, sending a full tablet report...
I20260923 19:43:51.115571 25481 ts_tablet_manager.cc:1428] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Time spent starting tablet: real 0.017s user 0.009s sys 0.005s
W20260923 19:43:51.138166 25185 tablet.cc:2369] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:43:51.174540 25462 tablet.cc:2369] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:43:51.248538 25328 tablet.cc:2369] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:43:51.356889 25487 raft_consensus.cc:482] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:43:51.357211 25487 raft_consensus.cc:504] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.358867 25487 leader_election.cc:288] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0a7f1b017a64c7a8bdcbcde7aaa0d1f (127.13.88.193:39565), bbe81b33b75b42f0856bc17f8b966d0e (127.13.88.194:33409)
I20260923 19:43:51.365190 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.359145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:33409 (local address 127.13.88.195:38191)
0923 19:43:51.359348 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:51.359370 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:51.359496 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:51.360139 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:51.360145 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:51.360210 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:51.360416 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.360430 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.361588 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.361595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.363239 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.363253 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.364487 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.364494 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.364691 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.364729 (+ 38us) client_negotiation.cc:769] Sending connection context
0923 19:43:51.364838 (+ 109us) client_negotiation.cc:240] Negotiation successful
0923 19:43:51.364974 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260923 19:43:51.365263 25477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.359489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:38191 (local address 127.13.88.194:33409)
0923 19:43:51.359733 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.359738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.359757 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:43:51.359841 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.359845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.359931 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.360036 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:51.360597 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.361451 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.363407 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.364344 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.364457 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.364517 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.364889 (+ 372us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.365013 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 19:43:51.365666 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.359356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:33389 (local address 127.13.88.193:39565)
0923 19:43:51.359571 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.359592 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.360057 (+ 465us) server_negotiation.cc:407] Connection header received
0923 19:43:51.360296 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.360302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.360381 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.360489 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:43:51.361024 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.361887 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.363870 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.364764 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.364903 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.364968 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.365313 (+ 345us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.365448 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:43:51.365742 25489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.359337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:39565 (local address 127.13.88.195:33389)
0923 19:43:51.359944 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0923 19:43:51.359961 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:43:51.360078 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:43:51.360502 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:43:51.360505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:43:51.360545 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:43:51.360881 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.360893 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.362061 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.362065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.363689 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:43:51.363703 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.364951 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.364958 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:43:51.365131 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.365165 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:43:51.365261 (+ 96us) client_negotiation.cc:240] Negotiation successful
0923 19:43:51.365389 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":335,"threads_started":1}
I20260923 19:43:51.367090 25282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15017acea83f42ae8b09d63e0d17e5b2" candidate_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" is_pre_election: true
I20260923 19:43:51.367233 25139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15017acea83f42ae8b09d63e0d17e5b2" candidate_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" is_pre_election: true
I20260923 19:43:51.367725 25282 raft_consensus.cc:2454] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 521fbf2c4ac4415eb8ff3fed88240c58 in term 0.
I20260923 19:43:51.367766 25139 raft_consensus.cc:2454] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 521fbf2c4ac4415eb8ff3fed88240c58 in term 0.
I20260923 19:43:51.368433 25350 leader_election.cc:302] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521fbf2c4ac4415eb8ff3fed88240c58, e0a7f1b017a64c7a8bdcbcde7aaa0d1f; no voters:
I20260923 19:43:51.368862 25487 raft_consensus.cc:2781] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:43:51.369015 25487 raft_consensus.cc:482] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:43:51.369151 25487 raft_consensus.cc:3037] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:51.371343 25487 raft_consensus.cc:504] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.371986 25487 leader_election.cc:288] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [CANDIDATE]: Term 1 election: Requested vote from peers e0a7f1b017a64c7a8bdcbcde7aaa0d1f (127.13.88.193:39565), bbe81b33b75b42f0856bc17f8b966d0e (127.13.88.194:33409)
I20260923 19:43:51.372455 25139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15017acea83f42ae8b09d63e0d17e5b2" candidate_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f"
I20260923 19:43:51.372542 25282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15017acea83f42ae8b09d63e0d17e5b2" candidate_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe81b33b75b42f0856bc17f8b966d0e"
I20260923 19:43:51.372674 25139 raft_consensus.cc:3037] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:51.372759 25282 raft_consensus.cc:3037] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:43:51.374976 25139 raft_consensus.cc:2454] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 521fbf2c4ac4415eb8ff3fed88240c58 in term 1.
I20260923 19:43:51.375456 25350 leader_election.cc:302] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521fbf2c4ac4415eb8ff3fed88240c58, e0a7f1b017a64c7a8bdcbcde7aaa0d1f; no voters:
I20260923 19:43:51.375771 25487 raft_consensus.cc:2781] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:43:51.375783 25282 raft_consensus.cc:2454] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 521fbf2c4ac4415eb8ff3fed88240c58 in term 1.
I20260923 19:43:51.376921 25487 raft_consensus.cc:686] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 1 LEADER]: Becoming Leader. State: Replica: 521fbf2c4ac4415eb8ff3fed88240c58, State: Running, Role: LEADER
I20260923 19:43:51.377418 25487 consensus_queue.cc:237] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } }
I20260923 19:43:51.382237 24969 catalog_manager.cc:5495] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 521fbf2c4ac4415eb8ff3fed88240c58 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "521fbf2c4ac4415eb8ff3fed88240c58" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 } health_report { overall_health: UNKNOWN } } }
I20260923 19:43:51.476742 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.471572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43594 (local address 127.13.88.195:37347)
0923 19:43:51.471790 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.471794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.471812 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:43:51.471990 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.471994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.472083 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.472204 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:43:51.472541 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.473341 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.474747 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.475152 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.475238 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.475668 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:43:51.476182 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:43:51.476288 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.476372 (+ 84us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.476435 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:43:51.484675 25282 raft_consensus.cc:1261] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 1 FOLLOWER]: Refusing update from remote peer 521fbf2c4ac4415eb8ff3fed88240c58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:43:51.484704 25139 raft_consensus.cc:1261] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 1 FOLLOWER]: Refusing update from remote peer 521fbf2c4ac4415eb8ff3fed88240c58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:43:51.485642 25490 consensus_queue.cc:1035] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe81b33b75b42f0856bc17f8b966d0e" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 33409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:43:51.486003 25487 consensus_queue.cc:1035] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0a7f1b017a64c7a8bdcbcde7aaa0d1f" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 39565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:43:51.513135 24971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:43:51.513479 24971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:43:51.517720 24971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f3e60e76636f49549c1a4de18fd97565: Sending DeleteTablet for 3 replicas of tablet 15017acea83f42ae8b09d63e0d17e5b2
I20260923 19:43:51.519090 25262 tablet_service.cc:1514] Processing DeleteTablet for tablet 15017acea83f42ae8b09d63e0d17e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:43:51 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:44404
I20260923 19:43:51.519129 25119 tablet_service.cc:1514] Processing DeleteTablet for tablet 15017acea83f42ae8b09d63e0d17e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:43:51 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34076
I20260923 19:43:51.520056 25396 tablet_service.cc:1514] Processing DeleteTablet for tablet 15017acea83f42ae8b09d63e0d17e5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:43:51 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:45956
I20260923 19:43:51.520812 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 25051
I20260923 19:43:51.538203 25503 tablet_replica.cc:330] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: stopping tablet replica
I20260923 19:43:51.538523 25505 tablet_replica.cc:330] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: stopping tablet replica
I20260923 19:43:51.538735 25503 raft_consensus.cc:2229] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:43:51.539228 25505 raft_consensus.cc:2229] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:43:51.539320 25503 raft_consensus.cc:2258] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:43:51.540102 25505 raft_consensus.cc:2258] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:43:51.540719 25504 tablet_replica.cc:330] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: stopping tablet replica
I20260923 19:43:51.541136 25504 raft_consensus.cc:2229] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:43:51.541627 25504 raft_consensus.cc:2258] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:43:51.544049 25504 ts_tablet_manager.cc:1905] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:43:51.544057 25505 ts_tablet_manager.cc:1905] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:43:51.544900 25503 ts_tablet_manager.cc:1905] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:43:51 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:43:51.551265 25504 ts_tablet_manager.cc:1918] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:43:51.551458 25504 log.cc:1196] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/15017acea83f42ae8b09d63e0d17e5b2
I20260923 19:43:51.551808 25505 ts_tablet_manager.cc:1918] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:43:51.551980 25505 log.cc:1196] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/15017acea83f42ae8b09d63e0d17e5b2
I20260923 19:43:51.552263 25504 ts_tablet_manager.cc:1939] T 15017acea83f42ae8b09d63e0d17e5b2 P bbe81b33b75b42f0856bc17f8b966d0e: Deleting consensus metadata
I20260923 19:43:51.552506 25505 ts_tablet_manager.cc:1939] T 15017acea83f42ae8b09d63e0d17e5b2 P 521fbf2c4ac4415eb8ff3fed88240c58: Deleting consensus metadata
I20260923 19:43:51.554225 24956 catalog_manager.cc:4841] TS 521fbf2c4ac4415eb8ff3fed88240c58 (127.13.88.195:37347): tablet 15017acea83f42ae8b09d63e0d17e5b2 (table test-table [id=1cb458d3d3f64949a5436bbaf542b12e]) successfully deleted
I20260923 19:43:51.554529 24955 catalog_manager.cc:4841] TS bbe81b33b75b42f0856bc17f8b966d0e (127.13.88.194:33409): tablet 15017acea83f42ae8b09d63e0d17e5b2 (table test-table [id=1cb458d3d3f64949a5436bbaf542b12e]) successfully deleted
I20260923 19:43:51.558480 25503 ts_tablet_manager.cc:1918] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:43:51.558689 25503 log.cc:1196] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/15017acea83f42ae8b09d63e0d17e5b2
I20260923 19:43:51.559228 25503 ts_tablet_manager.cc:1939] T 15017acea83f42ae8b09d63e0d17e5b2 P e0a7f1b017a64c7a8bdcbcde7aaa0d1f: Deleting consensus metadata
I20260923 19:43:51.560976 24956 catalog_manager.cc:4841] TS e0a7f1b017a64c7a8bdcbcde7aaa0d1f (127.13.88.193:39565): tablet 15017acea83f42ae8b09d63e0d17e5b2 (table test-table [id=1cb458d3d3f64949a5436bbaf542b12e]) successfully deleted
I20260923 19:43:51.563282 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.522912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.13.88.193:39565)
0923 19:43:51.523164 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.523174 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.534251 (+ 11077us) server_negotiation.cc:407] Connection header received
0923 19:43:51.534859 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.534869 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.534999 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.535125 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:51.539766 (+ 4641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.540920 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.545740 (+ 4820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.546402 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.546502 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.555660 (+ 9158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:51.555680 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:51.555700 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:51.555766 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:51.560056 (+ 4290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:51.561074 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:51.561082 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:51.561085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:51.561260 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:51.561674 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:51.561679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:51.561682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:51.562055 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:51.562354 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.562663 (+ 309us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.562883 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:43:51.564002 25179 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:51.653779 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 25051
I20260923 19:43:51.676015 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 25190
Sep 23 19:43:51 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:43:51.696777 25477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.677268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53958 (local address 127.13.88.194:33409)
0923 19:43:51.677450 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.677458 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.677485 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:43:51.678810 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.678816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.678897 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.678996 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:51.680878 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.682120 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.684146 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.684861 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.685008 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.690056 (+ 5048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:51.690078 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:51.690102 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:51.690163 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:51.693839 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:51.694525 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:51.694534 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:51.694538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:51.694670 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:51.695039 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:51.695044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:51.695048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:51.695573 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:51.695860 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.696155 (+ 295us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.696428 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:43:51.697638 25322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:51.785458 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 25190
I20260923 19:43:51.807685 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 25333
Sep 23 19:43:51 dist-test-slave-xg7f krb5kdc[24495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:43:51.825584 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:43:51.808765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43606 (local address 127.13.88.195:37347)
0923 19:43:51.808929 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 19:43:51.808933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:43:51.808950 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:43:51.809089 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:43:51.809093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:43:51.809172 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:43:51.809251 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:43:51.811038 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.812017 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.813890 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:43:51.814325 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:43:51.814422 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:43:51.819712 (+ 5290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:43:51.819723 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:43:51.819738 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:43:51.819780 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:43:51.822743 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:51.823431 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:51.823443 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:51.823445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:51.823604 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:43:51.823987 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:43:51.823995 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:43:51.823998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:43:51.824400 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:43:51.824716 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0923 19:43:51.825001 (+ 285us) server_negotiation.cc:299] Negotiation successful
0923 19:43:51.825228 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:43:51.826268 25456 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:51.948402 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 25333
I20260923 19:43:51.967633 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 24939
I20260923 19:43:51.968829 25001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:43:52.079639 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 24939
I20260923 19:43:52.100992 13667 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 19:43:52.436789 13667 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 19:43:52.436972 13667 mini_ranger.cc:66] Stopping Ranger...
I20260923 19:43:52.783324 13667 mini_ranger.cc:68] Stopped Ranger
2026-09-23 19:43:52.783 UTC [24525] LOG: received smart shutdown request
2026-09-23 19:43:52.786 UTC [24525] LOG: background worker "logical replication launcher" (PID 24534) exited with exit code 1
2026-09-23 19:43:52.786 UTC [24529] LOG: shutting down
2026-09-23 19:43:52.937 UTC [24525] LOG: database system is shut down
2026-09-23T19:43:52Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47411 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:43:53 dist-test-slave-xg7f krb5kdc[25519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:43:53 dist-test-slave-xg7f krb5kdc[25519](info): set up 2 sockets
Sep 23 19:43:53 dist-test-slave-xg7f krb5kdc[25519](info): commencing operation
krb5kdc: starting...
W20260923 19:43:54.163489 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:43:54 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:43:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:43:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/rangeradmin_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/rangeradmin_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/rangerlookup_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/rangerlookup_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
I20260923 19:43:54.458693 13667 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskZLYS4k/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/postgres -l logfile start
2026-09-23 19:43:56.669 UTC [25549] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 19:43:56.669 UTC [25549] LOG: listening on IPv4 address "127.13.88.212", port 37871
2026-09-23 19:43:56.672 UTC [25549] LOG: listening on Unix socket "/tmp/.s.PGSQL.37871"
2026-09-23 19:43:56.693 UTC [25552] LOG: database system was shut down at 2026-09-23 19:43:55 UTC
2026-09-23 19:43:56.697 UTC [25549] LOG: database system is ready to accept connections
I20260923 19:43:57.651232 13667 mini_postgres.cc:96] Postgres bound to 37871
2026-09-23 19:43:57.669 UTC [25560] FATAL: database "slave" does not exist
127.13.88.212:37871 - accepting connections
I20260923 19:43:57.670272 13667 mini_ranger.cc:161] Starting Ranger...
I20260923 19:43:57.696426 13667 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 19:43:58.104599 13667 mini_ranger.cc:87] Created ranger Postgres database
I20260923 19:43:58.104725 13667 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-admin
2026-09-23 19:43:58,373 [I] DB FLAVOR :POSTGRES
2026-09-23 19:43:58,374 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:43:58,374 [I] Checking connection..
2026-09-23 19:43:58,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 19:43:58,614 [I] Checking connection passed.
2026-09-23 19:43:58,614 [I] --------- Verifying version history table ---------
2026-09-23 19:43:58,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:43:58,869 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:43:58,870 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:43:59,116 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 19:43:59,117 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 19:43:59,117 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 19:43:59.371 UTC [25624] WARNING: there is no transaction in progress
2026-09-23 19:43:59,378 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 19:43:59,378 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 19:43:59,641 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 19:43:59,641 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:43:59,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 19:43:59,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 19:44:00,136 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-xg7f.c.gcp-upstream.internal','N') ;"
2026-09-23 19:44:00,352 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:44:00,602 [I] Table x_portal_user does not exist in database ranger
2026-09-23 19:44:00,603 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:44:00,860 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 19:44:00,860 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:44:01,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:44:01,350 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 19:44:01,350 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 19:44:02.269 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.284 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.299 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.313 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.327 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.343 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.394 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.400 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.413 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.422 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.431 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.443 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.452 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.457 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.463 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:02.469 UTC [25732] WARNING: there is no transaction in progress
2026-09-23 19:44:03,024 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 19:44:03,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 19:44:03,277 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 19:44:03,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 19:44:03,504 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 19:44:03,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 19:44:03,752 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 19:44:03,753 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 19:44:03,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 19:44:04,209 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-xg7f.c.gcp-upstream.internal';"
2026-09-23 19:44:04,454 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 19:44:04,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 19:44:04,693 [I] DB_PATCHES have already been applied
I20260923 19:44:04.698840 13667 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-admin:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskZLYS4k/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 19:44:04.698946 13667 mini_ranger.cc:193] Using host: 127.13.88.212
I20260923 19:44:04.712409 13667 mini_ranger.cc:227] Ranger admin URL: http://127.13.88.212:34985
Sep 23, 2026 7:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 7:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 7:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 7:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 7:44:05 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 19:44:05.849668 13667 mini_ranger.cc:160] Time spent starting Ranger: real 8.179s user 0.004s sys 0.033s
Sep 23, 2026 7:44:25 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 7:44:25 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 23, 2026 7:44:25 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 7:44:25 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 7:44:26 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 19:44:27.073987 13667 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.13.88.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.13.88.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/rangerkms_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.13.88.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/rangerkms_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.13.88.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.13.88.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.13.88.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/HTTP_127.13.88.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 19:44:27 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192667, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 19:44:27.225935 13667 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 19:44:27.245880 13667 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 19:44:27.976240 13667 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 19:44:27.976358 13667 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms
I20260923 19:44:27.976405 13667 mini_ranger_kms.cc:227] Using postgres at 127.13.88.212:37871
2026-09-23 19:44:28,326 [I] DB FLAVOR :POSTGRES
2026-09-23 19:44:28,326 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 19:44:28,326 [I] Checking connection
2026-09-23 19:44:28,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 19:44:28,566 [I] connection success
2026-09-23 19:44:28,566 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 19:44:28,566 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 19:44:28,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 19:44:28,804 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 19:44:28,804 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 19:44:28,804 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 19:44:28,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.13.88.212:37871/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 19:44:29,066 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 19:44:29.506855 13667 mini_ranger_kms.cc:310] Created kms service
I20260923 19:44:29.714273 13667 mini_ranger_kms.cc:326] Created kudu user
I20260923 19:44:29.767426 13667 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 19:44:29 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192667, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:30.181447 13667 mini_ranger_kms.cc:384] Added ranger policy
I20260923 19:44:30.181749 13667 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms:/tmp/dist-test-taskZLYS4k/build/asan/bin/postgresql.jar:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskZLYS4k/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 19:44:30.181798 13667 mini_ranger_kms.cc:240] Using host: 127.13.88.212
I20260923 19:44:30.198731 13667 mini_ranger_kms.cc:276] Ranger KMS PID: 25912
I20260923 19:44:30.198858 13667 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.13.88.212:41691
Sep 23, 2026 7:44:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 7:44:31 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 7:44:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 7:44:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 7:44:31 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 7:44:31 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260923 19:44:32.479580 13667 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.254s user 0.051s sys 0.316s
I20260923 19:44:32.479835 13667 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 19:44:32.480024 13667 mini_ranger_kms.cc:401] 127.13.88.212:41691/kms/v1/keys
Sep 23 19:44:32 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192672, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.88.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 23 19:44:32 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192672, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.88.212@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
Sep 23 19:44:33 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192672, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.13.88.212@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
Sep 23 19:44:35 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:44:35.398105 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36031
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:36031
--ranger_config_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:35.721266 25963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:35.721519 25963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:35.721599 25963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:35.728350 25963 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:35.728442 25963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:35.728487 25963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:35.728541 25963 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:35.728588 25963 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:35.737757 25963 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
--ranger_kms_url=127.13.88.212:41691/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:36031
--ranger_config_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:35.738955 25963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:35.740221 25963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:35.752254 25969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:35.752195 25971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:35.752221 25968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:35.752956 25963 server_base.cc:1034] running on GCE node
I20260923 19:44:35.753660 25963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:35.755021 25963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:35.756212 25963 hybrid_clock.cc:648] HybridClock initialized: now 1790192675756169 us; error 44 us; skew 500 ppm
I20260923 19:44:35.756556 25963 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:35 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192675, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:35.763762 25963 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:44:35.765169 25963 webserver.cc:460] Webserver started at http://127.13.88.254:39979/ using document root <none> and password file <none>
I20260923 19:44:35.765743 25963 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:35.765827 25963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:35.766093 25963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:44:35 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192675, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:35.822247 25963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "586919f0e87b4699b85592a0410412d2"
format_stamp: "Formatted at 2026-09-23 19:44:35 on dist-test-slave-xg7f"
server_key: "b126ef017a85fd76bff2fe4f2e31505a"
server_key_iv: "27204dea34d16418947f2c2cf7e646da"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:35.823310 25963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "586919f0e87b4699b85592a0410412d2"
format_stamp: "Formatted at 2026-09-23 19:44:35 on dist-test-slave-xg7f"
server_key: "b126ef017a85fd76bff2fe4f2e31505a"
server_key_iv: "27204dea34d16418947f2c2cf7e646da"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:35.829855 25963 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260923 19:44:35.846004 25978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:35.847620 25963 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:44:35.847842 25963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "586919f0e87b4699b85592a0410412d2"
format_stamp: "Formatted at 2026-09-23 19:44:35 on dist-test-slave-xg7f"
server_key: "b126ef017a85fd76bff2fe4f2e31505a"
server_key_iv: "27204dea34d16418947f2c2cf7e646da"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:35.848083 25963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:35.863978 25963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:35.868088 25963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:35.868397 25963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:35.888101 25963 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:36031
I20260923 19:44:35.888103 26029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:36031 every 8 connection(s)
I20260923 19:44:35.889500 25963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:44:35.890817 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 25963
I20260923 19:44:35.891033 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:44:35.891875 13667 external_mini_cluster.cc:1428] Setting key 9b0cc52b50afd75c95d8d465041b7a70
I20260923 19:44:35.901994 26030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:44:35 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:35.915927 26030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Bootstrap starting.
I20260923 19:44:35.919358 26030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:35.920668 26030 log.cc:824] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:35.923938 26033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:35.894268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60850 (local address 127.13.88.254:36031)
0923 19:44:35.900088 (+ 5820us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:35.900105 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:35.900157 (+ 52us) server_negotiation.cc:407] Connection header received
0923 19:44:35.902574 (+ 2417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:35.902606 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:35.903162 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:35.903605 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:35.905309 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:35.907384 (+ 2075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:35.909232 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:35.910273 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:35.910442 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:35.915432 (+ 4990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:35.915442 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:35.915462 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:35.915508 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:35.919457 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:35.920303 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:35.920330 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:35.920340 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:35.920558 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:35.920990 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:35.920995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:35.920999 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:35.921712 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:35.922020 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:35.922528 (+ 508us) server_negotiation.cc:299] Negotiation successful
0923 19:44:35.922930 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5537,"thread_start_us":7719,"threads_started":1}
I20260923 19:44:35.924304 26030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: No bootstrap required, opened a new log
I20260923 19:44:35.935039 26030 raft_consensus.cc:348] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:35.935497 26030 raft_consensus.cc:374] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:35.935599 26030 raft_consensus.cc:729] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 586919f0e87b4699b85592a0410412d2, State: Initialized, Role: FOLLOWER
I20260923 19:44:35.936193 26030 consensus_queue.cc:260] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:35.936483 26030 raft_consensus.cc:388] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:44:35.936618 26030 raft_consensus.cc:482] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:44:35.936791 26030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:35.939822 26030 raft_consensus.cc:504] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:35.940359 26030 leader_election.cc:302] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 586919f0e87b4699b85592a0410412d2; no voters:
I20260923 19:44:35.940936 26030 leader_election.cc:288] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:44:35.941032 26035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:44:35.941694 26035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 LEADER]: Becoming Leader. State: Replica: 586919f0e87b4699b85592a0410412d2, State: Running, Role: LEADER
I20260923 19:44:35.942291 26035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:35.942978 26030 sys_catalog.cc:564] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:35.944854 26036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "586919f0e87b4699b85592a0410412d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } } }
I20260923 19:44:35.945376 26036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:35.945387 26037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 586919f0e87b4699b85592a0410412d2. Latest consensus state: current_term: 1 leader_uuid: "586919f0e87b4699b85592a0410412d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } } }
I20260923 19:44:35.945739 26037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:35.947669 26043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:44:35.952852 26043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:44:35.953433 26030 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 19:44:35.977839 26043 catalog_manager.cc:1347] Generated new cluster ID: 7d7134a2d09e4177ae42e34dd8c4049e
I20260923 19:44:35.978041 26043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:44:35.990159 26043 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:44:35.992235 26043 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:44:36.002463 26043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Generated new TSK 0
I20260923 19:44:36.003659 26043 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:44:36.716741 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36031
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:44:36 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192676, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260923 19:44:37.112792 26075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:37.113263 26075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:37.113451 26075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:37.124257 26075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:37.124433 26075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:37.124640 26075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:44:37.140044 26075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.13.88.212:41691/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36031
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:37.141853 26075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:37.143632 26075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:37.160597 26085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:37.161406 26086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:37.173259 26075 server_base.cc:1034] running on GCE node
W20260923 19:44:37.173761 26088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:37.174578 26075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:37.175880 26075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:37.177178 26075 hybrid_clock.cc:648] HybridClock initialized: now 1790192677177117 us; error 46 us; skew 500 ppm
I20260923 19:44:37.177556 26075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:37 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192677, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:37.181734 26075 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:44:37.183765 26075 webserver.cc:460] Webserver started at http://127.13.88.193:38927/ using document root <none> and password file <none>
I20260923 19:44:37.184782 26075 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:37.184919 26075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:37.185258 26075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:44:37 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192677, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:37.207875 26075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "261fa5dfa4204bb0b4f67a2bb90bee19"
format_stamp: "Formatted at 2026-09-23 19:44:37 on dist-test-slave-xg7f"
server_key: "04359a2131ccf7761ba11565f1f968a7"
server_key_iv: "c66ea26aa50e4fdbfc55e0b99e37f478"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:37.209045 26075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "261fa5dfa4204bb0b4f67a2bb90bee19"
format_stamp: "Formatted at 2026-09-23 19:44:37 on dist-test-slave-xg7f"
server_key: "04359a2131ccf7761ba11565f1f968a7"
server_key_iv: "c66ea26aa50e4fdbfc55e0b99e37f478"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:37.220953 26075 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.007s sys 0.003s
I20260923 19:44:37.242645 26095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:37.244895 26075 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.005s
I20260923 19:44:37.245088 26075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "261fa5dfa4204bb0b4f67a2bb90bee19"
format_stamp: "Formatted at 2026-09-23 19:44:37 on dist-test-slave-xg7f"
server_key: "04359a2131ccf7761ba11565f1f968a7"
server_key_iv: "c66ea26aa50e4fdbfc55e0b99e37f478"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:37.245348 26075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:37.264385 26075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:37.269481 26075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:37.269848 26075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:37.276202 26075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:37.279078 26075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:37.279204 26075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260923 19:44:37.279376 26075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:37.279448 26075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:37.371084 26075 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:35431
I20260923 19:44:37.371163 26207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:35431 every 8 connection(s)
I20260923 19:44:37.372938 26075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:44:37.380270 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 26075
I20260923 19:44:37.380463 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:44:37.381268 13667 external_mini_cluster.cc:1428] Setting key 2e1fb00b1be6dd5c318b3f4fdbd3428d
Sep 23 19:44:37 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192677, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:37.400578 26210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:37.376831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36031 (local address 127.13.88.193:46931)
0923 19:44:37.378380 (+ 1549us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:37.378430 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:37.381629 (+ 3199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:37.382516 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:37.382528 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:37.383118 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:37.383880 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:37.383908 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:37.385338 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:37.385343 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:37.387377 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:37.387395 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:37.388688 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:37.388695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:37.388982 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:37.389799 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:37.389843 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:37.392629 (+ 2786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:37.396282 (+ 3653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:37.396290 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:37.396307 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:37.396810 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:37.397225 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:37.397229 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:37.397232 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:37.397435 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:37.398053 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:37.398060 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:37.398443 (+ 383us) client_negotiation.cc:769] Sending connection context
0923 19:44:37.398710 (+ 267us) client_negotiation.cc:240] Negotiation successful
0923 19:44:37.399243 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1217,"thread_start_us":978,"threads_started":1}
I20260923 19:44:37.401919 26211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:37.377337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:46931 (local address 127.13.88.254:36031)
0923 19:44:37.379742 (+ 2405us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:37.379748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:37.379770 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:44:37.382020 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:37.382026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:37.382120 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:37.382230 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:37.384090 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:37.385157 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:37.387552 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:37.388253 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:37.388355 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:37.392892 (+ 4537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:37.392898 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:37.392903 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:37.392946 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:37.396133 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:37.396964 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:37.396969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:37.396971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:37.397113 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:37.397550 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:37.397555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:37.397557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:37.397863 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:37.397990 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:37.401314 (+ 3324us) server_negotiation.cc:299] Negotiation successful
0923 19:44:37.401547 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2288,"thread_start_us":2192,"threads_started":1}
I20260923 19:44:37.403436 26208 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36031
I20260923 19:44:37.403748 26208 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:37.404618 26208 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
I20260923 19:44:37.407086 25995 ts_manager.cc:194] Registered new tserver with Master: 261fa5dfa4204bb0b4f67a2bb90bee19 (127.13.88.193:35431)
I20260923 19:44:37.409168 25995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:46931
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Sep 23 19:44:37 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192676, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:44:37.444952 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36031
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:44:37 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192676, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
W20260923 19:44:37.909487 26214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:37.909964 26214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:37.910161 26214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:37.920136 26214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:37.920300 26214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:37.920547 26214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:44:37.936040 26214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.13.88.212:41691/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36031
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:37.938007 26214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:37.939766 26214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:37.960090 26221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:37.961143 26222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:37.969046 26224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:37.970357 26214 server_base.cc:1034] running on GCE node
I20260923 19:44:37.971083 26214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:37.972167 26214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:37.973448 26214 hybrid_clock.cc:648] HybridClock initialized: now 1790192677973358 us; error 75 us; skew 500 ppm
I20260923 19:44:37.973882 26214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:37 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192677, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:37.977968 26214 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:44:37.997306 26214 webserver.cc:460] Webserver started at http://127.13.88.194:36969/ using document root <none> and password file <none>
I20260923 19:44:37.998345 26214 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:37.998458 26214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:37.998793 26214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:44:37 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192677, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:38.014107 26214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "341ae6c777df4733b5316e6955bc5a13"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "fc7f8f30e80a8752a089431e93b88f95"
server_key_iv: "718d200d6d82da0361e4329df5684ea0"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:38.014986 26214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "341ae6c777df4733b5316e6955bc5a13"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "fc7f8f30e80a8752a089431e93b88f95"
server_key_iv: "718d200d6d82da0361e4329df5684ea0"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:38.020457 26214 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:44:38.037735 26238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:38.039435 26214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:44:38.039628 26214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "341ae6c777df4733b5316e6955bc5a13"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "fc7f8f30e80a8752a089431e93b88f95"
server_key_iv: "718d200d6d82da0361e4329df5684ea0"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:38.039853 26214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:38.062963 26214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:38.066881 26214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:38.067246 26214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:38.068279 26214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:38.069715 26214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:38.069811 26214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:38.069950 26214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:38.070020 26214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:38.113026 26214 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:38371
I20260923 19:44:38.113214 26350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:38371 every 8 connection(s)
I20260923 19:44:38.114360 26214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:44:38.123659 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 26214
I20260923 19:44:38.123862 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:44:38.124595 13667 external_mini_cluster.cc:1428] Setting key d655a51ac220ad788aa36934b992a5bf
Sep 23 19:44:38 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192677, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:38.159228 26354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:38.118432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36031 (local address 127.13.88.194:48795)
0923 19:44:38.136567 (+ 18135us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:38.136628 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:38.138835 (+ 2207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:38.139722 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:38.139734 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:38.140305 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:38.141105 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:38.141129 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.142531 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.142537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:38.144564 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:38.144579 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.145833 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.145841 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:38.146131 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:38.146844 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:38.146887 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:38.150475 (+ 3588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:38.154589 (+ 4114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:38.154599 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:38.154616 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:38.155191 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:38.155606 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:38.155611 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:38.155615 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:38.155886 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:38.156575 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:38.156585 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:38.157002 (+ 417us) client_negotiation.cc:769] Sending connection context
0923 19:44:38.157278 (+ 276us) client_negotiation.cc:240] Negotiation successful
0923 19:44:38.157804 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17814,"thread_start_us":17542,"threads_started":1}
I20260923 19:44:38.160344 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:38.117546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:48795 (local address 127.13.88.254:36031)
0923 19:44:38.136403 (+ 18857us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:38.136410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:38.136787 (+ 377us) server_negotiation.cc:407] Connection header received
0923 19:44:38.139216 (+ 2429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:38.139223 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:38.139316 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:38.139428 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:38.141296 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.142358 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.144714 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.145407 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.145528 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:38.150760 (+ 5232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:38.150767 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:38.150772 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:38.150812 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:38.154406 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.155323 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.155329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.155333 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.155463 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.156017 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.156023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.156026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.156372 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:38.156508 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:38.159710 (+ 3202us) server_negotiation.cc:299] Negotiation successful
0923 19:44:38.159950 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18722,"thread_start_us":18855,"threads_started":1}
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:44:38.162365 26351 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36031
I20260923 19:44:38.162699 26351 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:38.163559 26351 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
I20260923 19:44:38.168525 25995 ts_manager.cc:194] Registered new tserver with Master: 341ae6c777df4733b5316e6955bc5a13 (127.13.88.194:38371)
I20260923 19:44:38.169600 25995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:48795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:44:38.197109 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36031
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:38.413214 26208 heartbeater.cc:503] Master 127.13.88.254:36031 was elected leader, sending a full tablet report...
W20260923 19:44:38.555872 26357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:38.556113 26357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:38.556198 26357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:38.562958 26357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:38.563051 26357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:38.563252 26357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:44:38.573261 26357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.13.88.212:41691/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36031
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:38.574407 26357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:38.575699 26357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:38.588124 26365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:38.588204 26362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:38.588173 26363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:38.589191 26357 server_base.cc:1034] running on GCE node
I20260923 19:44:38.589715 26357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:38.590607 26357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:38.591825 26357 hybrid_clock.cc:648] HybridClock initialized: now 1790192678591784 us; error 51 us; skew 500 ppm
I20260923 19:44:38.592144 26357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:38 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192678, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:38.595366 26357 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:44:38.596732 26357 webserver.cc:460] Webserver started at http://127.13.88.195:44599/ using document root <none> and password file <none>
I20260923 19:44:38.597411 26357 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:38.597555 26357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:38.597855 26357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 19:44:38 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192678, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:38.614686 26357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "ba4e4908ea2e4a0da5c146bd13758580"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "f0372b0b227e8b2e412d1fa99a53f91c"
server_key_iv: "a117c9dae2b3e5f969a349fbf3dce15a"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:38.615569 26357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "ba4e4908ea2e4a0da5c146bd13758580"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "f0372b0b227e8b2e412d1fa99a53f91c"
server_key_iv: "a117c9dae2b3e5f969a349fbf3dce15a"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:38.620980 26357 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260923 19:44:38.637858 26372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:38.639405 26357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:44:38.639581 26357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "ba4e4908ea2e4a0da5c146bd13758580"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "f0372b0b227e8b2e412d1fa99a53f91c"
server_key_iv: "a117c9dae2b3e5f969a349fbf3dce15a"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:38.639837 26357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:38.653635 26357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:38.656992 26357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:38.657310 26357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:38.658183 26357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:38.659447 26357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:38.659547 26357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:38.659704 26357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:38.659771 26357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:38.691465 26357 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:34709
I20260923 19:44:38.691510 26484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:34709 every 8 connection(s)
I20260923 19:44:38.692739 26357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:44:38.697312 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 26357
I20260923 19:44:38.697485 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:44:38.698109 13667 external_mini_cluster.cc:1428] Setting key da1d01210854a1046b073583b079d336
Sep 23 19:44:38 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192678, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:38.711738 26487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:38.695280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:36959 (local address 127.13.88.254:36031)
0923 19:44:38.695759 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:38.695763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:38.696528 (+ 765us) server_negotiation.cc:407] Connection header received
0923 19:44:38.698898 (+ 2370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:38.698904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:38.699011 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:38.699157 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:38.700681 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.701525 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.702979 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.703418 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.703515 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:38.706440 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:38.706444 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:38.706447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:38.706475 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:38.709063 (+ 2588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.709709 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.709713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.709715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.709824 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.710173 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.710176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.710178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.710421 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:38.710524 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:38.711068 (+ 544us) server_negotiation.cc:299] Negotiation successful
0923 19:44:38.711342 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":262,"threads_started":1}
I20260923 19:44:38.712831 26488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:38.695718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36031 (local address 127.13.88.195:36959)
0923 19:44:38.696365 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:38.696413 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:38.698605 (+ 2192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:38.699483 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:38.699491 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:38.699881 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:38.700532 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:38.700548 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.701657 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.701661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:38.702864 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:38.702875 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.703604 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.703608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:38.703788 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:38.704369 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:38.704389 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:38.706270 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:38.709172 (+ 2902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:38.709178 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:38.709208 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:38.709605 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:38.709909 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:38.709918 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:38.709921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:38.710087 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:38.710515 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:38.710519 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:38.710781 (+ 262us) client_negotiation.cc:769] Sending connection context
0923 19:44:38.710998 (+ 217us) client_negotiation.cc:240] Negotiation successful
0923 19:44:38.711490 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":267,"threads_started":1}
I20260923 19:44:38.714149 26485 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36031
I20260923 19:44:38.714433 26485 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:38.715090 26485 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
I20260923 19:44:38.716427 25995 ts_manager.cc:194] Registered new tserver with Master: ba4e4908ea2e4a0da5c146bd13758580 (127.13.88.195:34709)
I20260923 19:44:38.717165 25995 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:36959
I20260923 19:44:38.725438 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:44:38.727077 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 26075
Sep 23 19:44:38 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:44:38.741882 26490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:38.727974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53122 (local address 127.13.88.193:35431)
0923 19:44:38.728570 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:38.728577 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:38.728600 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:44:38.728651 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:38.728657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:38.728837 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:38.728965 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:38.730355 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.731369 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.732723 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.733241 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.733326 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:38.737085 (+ 3759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:38.737095 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:38.737107 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:38.737137 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:38.739711 (+ 2574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.740275 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.740281 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.740284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.740417 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.740699 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.740702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.740704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.740975 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:38.741206 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:38.741433 (+ 227us) server_negotiation.cc:299] Negotiation successful
0923 19:44:38.741614 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":296,"threads_started":1}
I20260923 19:44:38.743151 26203 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:38.824976 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 26075
I20260923 19:44:38.840531 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 26214
Sep 23 19:44:38 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:44:38.856712 26492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:38.841367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39196 (local address 127.13.88.194:38371)
0923 19:44:38.841858 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:38.841865 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:38.841890 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:44:38.841947 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:38.841953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:38.842165 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:38.842330 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:38.843682 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.844862 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.846148 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.846687 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.846842 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:38.851089 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:38.851139 (+ 50us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:38.851163 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:38.851196 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:38.853803 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.854468 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.854476 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.854478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.854603 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.854995 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.855002 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.855006 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.855458 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:38.855770 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:38.856094 (+ 324us) server_negotiation.cc:299] Negotiation successful
0923 19:44:38.856352 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":265,"threads_started":1}
I20260923 19:44:38.857965 26346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:38.938534 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 26214
I20260923 19:44:38.954550 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 26357
Sep 23 19:44:38 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:44:38.970294 26494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:38.955667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51662 (local address 127.13.88.195:34709)
0923 19:44:38.956296 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:38.956303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:38.956331 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:44:38.956398 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:38.956404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:38.956622 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:38.956742 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:38.957926 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.958908 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.960207 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:38.960798 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:38.960892 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:38.965134 (+ 4242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:38.965144 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:38.965157 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:38.965191 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:38.968070 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.968668 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.968674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.968676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.968795 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:38.969113 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:38.969116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:38.969118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:38.969426 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:38.969645 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:38.969851 (+ 206us) server_negotiation.cc:299] Negotiation successful
0923 19:44:38.970027 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":344,"threads_started":1}
I20260923 19:44:38.971637 26480 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:39.052212 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 26357
I20260923 19:44:39.067385 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 25963
I20260923 19:44:39.068614 26025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:39.173465 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 25963
I20260923 19:44:39.197248 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36031
--webserver_interface=127.13.88.254
--webserver_port=39979
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:36031
--ranger_config_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:39.515033 26497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:39.515331 26497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:39.515501 26497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:39.522677 26497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:39.522778 26497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:39.522825 26497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:39.522917 26497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:39.523011 26497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:39.533026 26497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:36031
--ranger_config_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=39979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:39.534332 26497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:39.535666 26497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:39.547505 26502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:39.547547 26505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:39.547628 26503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:39.548390 26497 server_base.cc:1034] running on GCE node
I20260923 19:44:39.549079 26497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:39.550406 26497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:39.551599 26497 hybrid_clock.cc:648] HybridClock initialized: now 1790192679551542 us; error 53 us; skew 500 ppm
I20260923 19:44:39.551900 26497 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:39 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192679, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:39.554939 26497 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:44:39.556453 26497 webserver.cc:460] Webserver started at http://127.13.88.254:39979/ using document root <none> and password file <none>
I20260923 19:44:39.557046 26497 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:39.557148 26497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:44:39 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192679, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:39.607276 26497 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:44:39.610364 26513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:39.612108 26497 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:44:39.612349 26497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "586919f0e87b4699b85592a0410412d2"
format_stamp: "Formatted at 2026-09-23 19:44:35 on dist-test-slave-xg7f"
server_key: "b126ef017a85fd76bff2fe4f2e31505a"
server_key_iv: "27204dea34d16418947f2c2cf7e646da"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:39.613567 26497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:39.626250 26497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:39.630017 26497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:39.630288 26497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:39.648085 26497 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:36031
I20260923 19:44:39.648105 26564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:36031 every 8 connection(s)
I20260923 19:44:39.649569 26497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:44:39.650600 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 26497
I20260923 19:44:39.651527 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:35431
--local_ip_for_outbound_sockets=127.13.88.193
--tserver_master_addrs=127.13.88.254:36031
--webserver_port=38927
--webserver_interface=127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:39.656657 26565 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:44:39.659823 26565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Bootstrap starting.
I20260923 19:44:39.680166 26565 log.cc:824] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:39.688287 26565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:44:39.688781 26565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Bootstrap complete.
I20260923 19:44:39.697001 26565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:39.697767 26565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 586919f0e87b4699b85592a0410412d2, State: Initialized, Role: FOLLOWER
I20260923 19:44:39.698403 26565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:39.698635 26565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:44:39.698757 26565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:44:39.698936 26565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:44:39.702651 26565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:39.703217 26565 leader_election.cc:302] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 586919f0e87b4699b85592a0410412d2; no voters:
I20260923 19:44:39.703828 26565 leader_election.cc:288] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:44:39.703977 26569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:44:39.705125 26569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [term 2 LEADER]: Becoming Leader. State: Replica: 586919f0e87b4699b85592a0410412d2, State: Running, Role: LEADER
I20260923 19:44:39.705667 26569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } }
I20260923 19:44:39.705957 26565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:39.708050 26571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 586919f0e87b4699b85592a0410412d2. Latest consensus state: current_term: 2 leader_uuid: "586919f0e87b4699b85592a0410412d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } } }
I20260923 19:44:39.708408 26571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:39.708932 26570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "586919f0e87b4699b85592a0410412d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "586919f0e87b4699b85592a0410412d2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36031 } } }
I20260923 19:44:39.709197 26570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:39.712595 26575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:44:39.720047 26575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:44:39.721771 26575 catalog_manager.cc:1259] Loaded cluster ID: 7d7134a2d09e4177ae42e34dd8c4049e
I20260923 19:44:39.721881 26575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:44:39.726789 26575 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:44:39.728545 26575 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Loaded TSK: 0
I20260923 19:44:39.730317 26575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:44:39.733145 26565 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260923 19:44:40.086115 26567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:40.086457 26567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:40.086620 26567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:40.097649 26567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:40.097797 26567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:40.098008 26567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:44:40.113729 26567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:35431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=38927
--tserver_master_addrs=127.13.88.254:36031
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:40.115173 26567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:40.116860 26567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:40.135716 26602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:40.141652 26603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:40.153625 26567 server_base.cc:1034] running on GCE node
W20260923 19:44:40.154311 26605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:40.155071 26567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:40.156776 26567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:40.158020 26567 hybrid_clock.cc:648] HybridClock initialized: now 1790192680157941 us; error 68 us; skew 500 ppm
I20260923 19:44:40.158392 26567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:40 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:40.161671 26567 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:44:40.167173 26567 webserver.cc:460] Webserver started at http://127.13.88.193:38927/ using document root <none> and password file <none>
I20260923 19:44:40.168193 26567 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:40.168346 26567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:44:40 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:40.219539 26567 fs_manager.cc:709] Time spent opening directory manager: real 0.013s user 0.004s sys 0.002s
I20260923 19:44:40.243733 26613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:40.245882 26567 fs_manager.cc:725] Time spent opening block manager: real 0.023s user 0.008s sys 0.012s
I20260923 19:44:40.246093 26567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "261fa5dfa4204bb0b4f67a2bb90bee19"
format_stamp: "Formatted at 2026-09-23 19:44:37 on dist-test-slave-xg7f"
server_key: "04359a2131ccf7761ba11565f1f968a7"
server_key_iv: "c66ea26aa50e4fdbfc55e0b99e37f478"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:40.247586 26567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:40.277376 26567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:40.282716 26567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:40.283120 26567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:40.284453 26567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:40.285866 26567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:40.286000 26567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:40.286134 26567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:40.286238 26567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:40.332932 26567 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:35431
I20260923 19:44:40.332971 26726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:35431 every 8 connection(s)
I20260923 19:44:40.334432 26567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:44:40.335628 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 26567
I20260923 19:44:40.336625 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:38371
--local_ip_for_outbound_sockets=127.13.88.194
--tserver_master_addrs=127.13.88.254:36031
--webserver_port=36969
--webserver_interface=127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:44:40 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:40.376147 26729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:40.339134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36031 (local address 127.13.88.193:56479)
0923 19:44:40.351744 (+ 12610us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:40.351804 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:40.354003 (+ 2199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:40.355567 (+ 1564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:40.355578 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:40.356113 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:40.356666 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:40.356683 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:40.358429 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:40.358434 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:40.360193 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:40.360208 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:40.361906 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:40.361913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:40.362202 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:40.363089 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:40.363187 (+ 98us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:40.366058 (+ 2871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:40.370613 (+ 4555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:40.370623 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:40.370640 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:40.371353 (+ 713us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:40.371964 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:40.371969 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:40.371973 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:40.372239 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:40.373330 (+ 1091us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:40.373338 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:40.373761 (+ 423us) client_negotiation.cc:769] Sending connection context
0923 19:44:40.374080 (+ 319us) client_negotiation.cc:240] Negotiation successful
0923 19:44:40.374679 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12282,"thread_start_us":12148,"threads_started":1}
I20260923 19:44:40.376885 26730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:40.339187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:56479 (local address 127.13.88.254:36031)
0923 19:44:40.352353 (+ 13166us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:40.352375 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:40.352435 (+ 60us) server_negotiation.cc:407] Connection header received
0923 19:44:40.354625 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:40.354639 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:40.354998 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:40.355414 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:40.356853 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:40.358260 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:40.360371 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:40.361649 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:40.361870 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:40.366374 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:40.366394 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:40.366415 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:40.366466 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:40.370426 (+ 3960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:40.371546 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:40.371557 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:40.371565 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:40.371790 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:40.372390 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:40.372395 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:40.372399 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:40.373069 (+ 670us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:40.373258 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:40.375234 (+ 1976us) server_negotiation.cc:299] Negotiation successful
0923 19:44:40.375661 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11784,"thread_start_us":13294,"threads_started":1}
I20260923 19:44:40.380326 26727 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36031
I20260923 19:44:40.380645 26727 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:40.381446 26727 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
W20260923 19:44:40.384490 26727 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:36031 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:44:40.384719 26727 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:40.384980 26727 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
I20260923 19:44:40.386050 26727 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:40.386310 26727 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
W20260923 19:44:40.387352 26727 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 19:44:40.741430 26731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:40.741717 26731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:40.741864 26731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:40.749406 26731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:40.749552 26731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:40.749738 26731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:44:40.760104 26731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:38371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=36969
--tserver_master_addrs=127.13.88.254:36031
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:40.761412 26731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:40.763003 26731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:40.777612 26744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:40.778293 26746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:40.778501 26743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:40.778796 26731 server_base.cc:1034] running on GCE node
I20260923 19:44:40.779486 26731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:40.780465 26731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:40.781675 26731 hybrid_clock.cc:648] HybridClock initialized: now 1790192680781621 us; error 47 us; skew 500 ppm
I20260923 19:44:40.781988 26731 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:40 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:40.789336 26731 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:44:40.801432 26731 webserver.cc:460] Webserver started at http://127.13.88.194:36969/ using document root <none> and password file <none>
I20260923 19:44:40.802208 26731 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:40.802379 26731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:44:40 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:40.840845 26731 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.001s sys 0.016s
I20260923 19:44:40.844551 26756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:40.846352 26731 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:44:40.846593 26731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "341ae6c777df4733b5316e6955bc5a13"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "fc7f8f30e80a8752a089431e93b88f95"
server_key_iv: "718d200d6d82da0361e4329df5684ea0"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:40.848270 26731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:40.891878 26731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:40.896869 26731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:40.897248 26731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:40.904721 26731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:40.909864 26731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:40.910105 26731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260923 19:44:40.910246 26731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:40.910353 26731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:44:40 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:41.045753 26731 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:38371
I20260923 19:44:41.045814 26870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:38371 every 8 connection(s)
I20260923 19:44:41.048187 26731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:44:41.056537 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 26731
I20260923 19:44:41.057243 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.13.88.212:41691/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:34709
--local_ip_for_outbound_sockets=127.13.88.195
--tserver_master_addrs=127.13.88.254:36031
--webserver_port=44599
--webserver_interface=127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:44:41 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:41.081386 26874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:41.054837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:50459 (local address 127.13.88.254:36031)
0923 19:44:41.060736 (+ 5899us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:41.060742 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:41.060765 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:44:41.060831 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:41.060836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:41.060918 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:41.061025 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:41.065300 (+ 4275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.066502 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.068903 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.069558 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.069651 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:41.074114 (+ 4463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:41.074121 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:41.074125 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:41.074166 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:41.077737 (+ 3571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.078629 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.078634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.078637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.078782 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.079346 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.079351 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.079355 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.079727 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:41.079867 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:41.080799 (+ 932us) server_negotiation.cc:299] Negotiation successful
0923 19:44:41.081019 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2378,"thread_start_us":4275,"threads_started":1}
I20260923 19:44:41.083881 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:41.054285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36031 (local address 127.13.88.194:50459)
0923 19:44:41.057666 (+ 3381us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:41.057719 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:41.060082 (+ 2363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:41.063556 (+ 3474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:41.063569 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:41.064210 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:41.065082 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:41.065113 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.066738 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.066743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:41.068741 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:41.068755 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.070011 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.070018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:41.070304 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:41.071081 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:41.071135 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:41.073868 (+ 2733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:41.077900 (+ 4032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:41.077909 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:41.077927 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:41.078497 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:41.078924 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:41.078929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:41.078932 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:41.079212 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:41.079952 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:41.079959 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:41.080355 (+ 396us) client_negotiation.cc:769] Sending connection context
0923 19:44:41.081935 (+ 1580us) client_negotiation.cc:240] Negotiation successful
0923 19:44:41.082498 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2021,"thread_start_us":10207,"threads_started":1}
I20260923 19:44:41.086473 26871 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36031
I20260923 19:44:41.086791 26871 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:41.087648 26871 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
I20260923 19:44:41.089392 26530 ts_manager.cc:194] Registered new tserver with Master: 341ae6c777df4733b5316e6955bc5a13 (127.13.88.194:38371)
I20260923 19:44:41.091663 26530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:50459
I20260923 19:44:41.387526 26727 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:41.387957 26727 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
I20260923 19:44:41.389163 26530 ts_manager.cc:194] Registered new tserver with Master: 261fa5dfa4204bb0b4f67a2bb90bee19 (127.13.88.193:35431)
I20260923 19:44:41.390332 26530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:56479
Sep 23 19:44:41 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
W20260923 19:44:41.529552 26875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:41.529933 26875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:41.530088 26875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:41.540431 26875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:41.540570 26875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:41.540727 26875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:44:41.555119 26875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.13.88.212:41691/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:34709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=44599
--tserver_master_addrs=127.13.88.254:36031
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:41.556762 26875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:41.558425 26875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:41.574644 26881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:41.575559 26882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:41.580216 26884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:41.581040 26875 server_base.cc:1034] running on GCE node
I20260923 19:44:41.581634 26875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:41.582844 26875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:41.584080 26875 hybrid_clock.cc:648] HybridClock initialized: now 1790192681584007 us; error 67 us; skew 500 ppm
I20260923 19:44:41.584575 26875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:41 dist-test-slave-xg7f krb5kdc[25519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192681, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:41.587952 26875 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:44:41.593401 26875 webserver.cc:460] Webserver started at http://127.13.88.195:44599/ using document root <none> and password file <none>
I20260923 19:44:41.594368 26875 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:41.594527 26875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 19:44:41 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192681, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:41.624900 26875 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.003s
I20260923 19:44:41.628346 26892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:41.630131 26875 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:44:41.630285 26875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "ba4e4908ea2e4a0da5c146bd13758580"
format_stamp: "Formatted at 2026-09-23 19:44:38 on dist-test-slave-xg7f"
server_key: "f0372b0b227e8b2e412d1fa99a53f91c"
server_key_iv: "a117c9dae2b3e5f969a349fbf3dce15a"
server_key_version: "kuduclusterkey@0"
I20260923 19:44:41.631621 26875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:41.651943 26875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:41.656620 26875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:41.656917 26875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:41.658797 26875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:41.660516 26875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:41.660620 26875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:41.660727 26875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:41.660804 26875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 19:44:41 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192680, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for HTTP/127.13.88.212@KRBTEST.COM
I20260923 19:44:41.887178 26875 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:34709
I20260923 19:44:41.887228 27005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:34709 every 8 connection(s)
I20260923 19:44:41.889205 26875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:44:41.895565 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 26875
Sep 23 19:44:41 dist-test-slave-xg7f krb5kdc[25519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192681, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:41.922415 27009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:41.893910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36031 (local address 127.13.88.195:56673)
0923 19:44:41.899082 (+ 5172us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:41.899156 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:41.901513 (+ 2357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:41.903064 (+ 1551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:41.903077 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:41.903775 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:41.904568 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:41.904601 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.906194 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.906200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:41.908265 (+ 2065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:41.908280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.909617 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.909625 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:41.909904 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:41.910750 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:41.910778 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:41.913538 (+ 2760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:41.917714 (+ 4176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:41.917723 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:41.917740 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:41.918331 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:41.918748 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:41.918753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:41.918757 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:41.919011 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:41.919805 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:41.919813 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:41.920226 (+ 413us) client_negotiation.cc:769] Sending connection context
0923 19:44:41.920545 (+ 319us) client_negotiation.cc:240] Negotiation successful
0923 19:44:41.921082 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4880,"thread_start_us":3760,"threads_started":1}
I20260923 19:44:41.923543 27008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:41.893238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:56673 (local address 127.13.88.254:36031)
0923 19:44:41.902334 (+ 9096us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:41.902341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:41.902361 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:44:41.902424 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:41.902429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:41.902506 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:41.902616 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:41.904778 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.906001 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.908468 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.909134 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.909257 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:41.913836 (+ 4579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:41.913843 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:41.913848 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:41.913887 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:41.917552 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.918470 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.918476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.918480 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.918621 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.919196 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.919201 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.919204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.919591 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:41.919738 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:41.922897 (+ 3159us) server_negotiation.cc:299] Negotiation successful
0923 19:44:41.923165 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8952,"thread_start_us":8802,"threads_started":1}
I20260923 19:44:41.926481 27006 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36031
I20260923 19:44:41.926815 27006 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:41.927732 27006 heartbeater.cc:511] Master 127.13.88.254:36031 requested a full tablet report, sending...
I20260923 19:44:41.929464 26530 ts_manager.cc:194] Registered new tserver with Master: ba4e4908ea2e4a0da5c146bd13758580 (127.13.88.195:34709)
I20260923 19:44:41.930768 26530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:56673
I20260923 19:44:41.942528 27008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:41.902246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.13.88.254:36031)
0923 19:44:41.924117 (+ 21871us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:41.924122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:41.924138 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:44:41.924183 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:41.924188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:41.924277 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:41.924386 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:41.929913 (+ 5527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.931078 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.933110 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.933663 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.933814 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:41.937181 (+ 3367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:41.937189 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:41.937198 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:41.937228 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:41.939841 (+ 2613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.940598 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.940606 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.940610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.940732 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.941136 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.941144 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.941148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.941409 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:41.941674 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:41.941998 (+ 324us) server_negotiation.cc:299] Negotiation successful
0923 19:44:41.942206 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":21746,"thread_start_us":22348,"threads_started":1}
I20260923 19:44:41.945930 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:44:41.986074 27008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:41.961678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44300 (local address 127.13.88.254:36031)
0923 19:44:41.961874 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:41.961880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:41.968617 (+ 6737us) server_negotiation.cc:407] Connection header received
0923 19:44:41.969154 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:41.969161 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:41.969259 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:41.969337 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:41.971691 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.972862 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.974913 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:41.975584 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:41.975686 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:41.979293 (+ 3607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:41.979300 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:41.979305 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:41.979345 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:41.982832 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.983698 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.983703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.983706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.983864 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:41.984316 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:41.984321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:41.984325 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:41.984672 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:41.984904 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:41.985484 (+ 580us) server_negotiation.cc:299] Negotiation successful
0923 19:44:41.985709 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:44:41.992913 26530 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:44:42.004158 26530 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:44:42.043680 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.024482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42978 (local address 127.13.88.195:34709)
0923 19:44:42.034005 (+ 9523us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.034014 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.034048 (+ 34us) server_negotiation.cc:407] Connection header received
0923 19:44:42.034146 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.034155 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.034434 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.034648 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:42.036252 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.037908 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.040896 (+ 2988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.042112 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.042241 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.042469 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.043093 (+ 624us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.043319 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9338,"thread_start_us":10610,"threads_started":1}
I20260923 19:44:42.044745 27023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.024185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:34709 (local address 127.0.0.1:42978)
0923 19:44:42.033194 (+ 9009us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:42.033235 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:42.033431 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:42.034969 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:42.034976 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:42.035005 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:42.035451 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.035469 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.038073 (+ 2604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.038082 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.040684 (+ 2602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.040701 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.042653 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.042659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.042848 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.042899 (+ 51us) client_negotiation.cc:769] Sending connection context
0923 19:44:42.044194 (+ 1295us) client_negotiation.cc:240] Negotiation successful
0923 19:44:42.044405 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8756,"thread_start_us":12434,"threads_started":1}
I20260923 19:44:42.049081 26940 tablet_service.cc:1467] Processing CreateTablet for tablet c7b29a69dc0a4775af37cbaa863a057e (DEFAULT_TABLE table=test-table [id=3f3aa423eaa542aba57891a371e3f917]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:42.050835 26940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b29a69dc0a4775af37cbaa863a057e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:42.053512 27026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.027713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:38371 (local address 127.0.0.1:48116)
0923 19:44:42.035737 (+ 8024us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:42.035756 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:42.036406 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:42.039095 (+ 2689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:42.039122 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:42.039149 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:42.039552 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.039565 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.047975 (+ 8410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.047980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.050069 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.050086 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.052208 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.052214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.052740 (+ 526us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.052801 (+ 61us) client_negotiation.cc:769] Sending connection context
0923 19:44:42.052914 (+ 113us) client_negotiation.cc:240] Negotiation successful
0923 19:44:42.053069 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7862,"mutex_wait_us":314,"thread_start_us":5089,"threads_started":1}
I20260923 19:44:42.054466 27024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.028235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48116 (local address 127.13.88.194:38371)
0923 19:44:42.032632 (+ 4397us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.032642 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.035985 (+ 3343us) server_negotiation.cc:407] Connection header received
0923 19:44:42.036618 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.036626 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.036888 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.037148 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:42.046158 (+ 9010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.047787 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.050259 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.051850 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.052009 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.052681 (+ 672us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.053975 (+ 1294us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.054137 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4229,"thread_start_us":4102,"threads_started":1}
I20260923 19:44:42.057385 27021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.034693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:35431 (local address 127.0.0.1:41812)
0923 19:44:42.035998 (+ 1305us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:42.036015 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:42.036108 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:42.040688 (+ 4580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:42.040693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:42.040716 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:42.041117 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.041127 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.052298 (+ 11171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.052313 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.054433 (+ 2120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.054453 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.056510 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.056516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.056690 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.056725 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 19:44:42.056836 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 19:44:42.056997 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1198,"mutex_wait_us":1,"thread_start_us":2122,"threads_started":1}
I20260923 19:44:42.058166 27027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.035312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41812 (local address 127.13.88.193:35431)
0923 19:44:42.040114 (+ 4802us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.040123 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.040148 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:44:42.040233 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.040240 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.040475 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.041299 (+ 824us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:42.041525 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.043009 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.054759 (+ 11750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.056261 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.056424 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.056663 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.057636 (+ 973us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.057829 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4637,"thread_start_us":4568,"threads_started":1}
I20260923 19:44:42.058465 26806 tablet_service.cc:1467] Processing CreateTablet for tablet c7b29a69dc0a4775af37cbaa863a057e (DEFAULT_TABLE table=test-table [id=3f3aa423eaa542aba57891a371e3f917]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:42.060002 26806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b29a69dc0a4775af37cbaa863a057e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:42.066974 26662 tablet_service.cc:1467] Processing CreateTablet for tablet c7b29a69dc0a4775af37cbaa863a057e (DEFAULT_TABLE table=test-table [id=3f3aa423eaa542aba57891a371e3f917]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:42.068660 26662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7b29a69dc0a4775af37cbaa863a057e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:42.083576 27032 tablet_bootstrap.cc:492] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Bootstrap starting.
I20260923 19:44:42.086853 27032 tablet_bootstrap.cc:654] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:42.088115 27032 log.cc:824] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:42.094786 27032 tablet_bootstrap.cc:492] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: No bootstrap required, opened a new log
I20260923 19:44:42.095281 27032 ts_tablet_manager.cc:1397] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260923 19:44:42.095425 26871 heartbeater.cc:503] Master 127.13.88.254:36031 was elected leader, sending a full tablet report...
I20260923 19:44:42.095829 27035 tablet_bootstrap.cc:492] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Bootstrap starting.
I20260923 19:44:42.096768 27036 tablet_bootstrap.cc:492] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Bootstrap starting.
I20260923 19:44:42.099375 27035 tablet_bootstrap.cc:654] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:42.100148 27036 tablet_bootstrap.cc:654] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:42.100663 27035 log.cc:824] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:42.101339 27036 log.cc:824] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:42.105942 27032 raft_consensus.cc:348] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.106468 27032 raft_consensus.cc:374] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:42.106571 27032 raft_consensus.cc:729] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4e4908ea2e4a0da5c146bd13758580, State: Initialized, Role: FOLLOWER
I20260923 19:44:42.107223 27032 consensus_queue.cc:260] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.109820 27035 tablet_bootstrap.cc:492] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: No bootstrap required, opened a new log
I20260923 19:44:42.109833 27036 tablet_bootstrap.cc:492] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: No bootstrap required, opened a new log
I20260923 19:44:42.110105 27035 ts_tablet_manager.cc:1397] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.005s
I20260923 19:44:42.110103 27036 ts_tablet_manager.cc:1397] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260923 19:44:42.119867 27006 heartbeater.cc:503] Master 127.13.88.254:36031 was elected leader, sending a full tablet report...
I20260923 19:44:42.120625 27032 ts_tablet_manager.cc:1428] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Time spent starting tablet: real 0.025s user 0.020s sys 0.004s
I20260923 19:44:42.121337 27036 raft_consensus.cc:348] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.121863 27036 raft_consensus.cc:374] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:42.122004 27036 raft_consensus.cc:729] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 261fa5dfa4204bb0b4f67a2bb90bee19, State: Initialized, Role: FOLLOWER
I20260923 19:44:42.122534 27035 raft_consensus.cc:348] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.122970 27035 raft_consensus.cc:374] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:42.123114 27035 raft_consensus.cc:729] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 341ae6c777df4733b5316e6955bc5a13, State: Initialized, Role: FOLLOWER
I20260923 19:44:42.123584 27036 consensus_queue.cc:260] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.123715 27035 consensus_queue.cc:260] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.128182 26727 heartbeater.cc:503] Master 127.13.88.254:36031 was elected leader, sending a full tablet report...
I20260923 19:44:42.128710 27035 ts_tablet_manager.cc:1428] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Time spent starting tablet: real 0.018s user 0.009s sys 0.006s
I20260923 19:44:42.129434 27036 ts_tablet_manager.cc:1428] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Time spent starting tablet: real 0.019s user 0.018s sys 0.000s
W20260923 19:44:42.142544 27007 tablet.cc:2369] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:44:42.314518 26872 tablet.cc:2369] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:44:42.328768 27042 raft_consensus.cc:482] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:44:42.329066 27042 raft_consensus.cc:504] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.330952 27042 leader_election.cc:288] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba4e4908ea2e4a0da5c146bd13758580 (127.13.88.195:34709), 261fa5dfa4204bb0b4f67a2bb90bee19 (127.13.88.193:35431)
W20260923 19:44:42.339825 26728 tablet.cc:2369] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:44:42.340970 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.331494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:34205 (local address 127.13.88.195:34709)
0923 19:44:42.331724 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.331733 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.332393 (+ 660us) server_negotiation.cc:407] Connection header received
0923 19:44:42.332627 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.332632 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.332705 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.332764 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:42.333509 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.334597 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.338535 (+ 3938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.339745 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.339869 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.339941 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.340592 (+ 651us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.340727 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 19:44:42.341840 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.331370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:34709 (local address 127.13.88.194:34205)
0923 19:44:42.332284 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:42.332300 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:42.332468 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:42.332955 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:42.332960 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:42.332986 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:42.333341 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.333352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.334769 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.334774 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.338354 (+ 3580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.338369 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.340212 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.340218 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.340406 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.340440 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:44:42.341354 (+ 914us) client_negotiation.cc:240] Negotiation successful
0923 19:44:42.341506 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":565,"threads_started":1}
I20260923 19:44:42.342995 26960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b29a69dc0a4775af37cbaa863a057e" candidate_uuid: "341ae6c777df4733b5316e6955bc5a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4e4908ea2e4a0da5c146bd13758580" is_pre_election: true
I20260923 19:44:42.343571 26960 raft_consensus.cc:2454] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 341ae6c777df4733b5316e6955bc5a13 in term 0.
I20260923 19:44:42.345515 26759 leader_election.cc:302] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 341ae6c777df4733b5316e6955bc5a13, ba4e4908ea2e4a0da5c146bd13758580; no voters:
I20260923 19:44:42.346007 27042 raft_consensus.cc:2781] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:44:42.346140 27042 raft_consensus.cc:482] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:44:42.346222 27042 raft_consensus.cc:3037] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:42.349486 27042 raft_consensus.cc:504] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.350384 27042 leader_election.cc:288] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [CANDIDATE]: Term 1 election: Requested vote from peers ba4e4908ea2e4a0da5c146bd13758580 (127.13.88.195:34709), 261fa5dfa4204bb0b4f67a2bb90bee19 (127.13.88.193:35431)
I20260923 19:44:42.350548 26960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b29a69dc0a4775af37cbaa863a057e" candidate_uuid: "341ae6c777df4733b5316e6955bc5a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba4e4908ea2e4a0da5c146bd13758580"
I20260923 19:44:42.350764 26960 raft_consensus.cc:3037] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:42.352855 27027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.331483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:60467 (local address 127.13.88.193:35431)
0923 19:44:42.331685 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.331691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.342762 (+ 11071us) server_negotiation.cc:407] Connection header received
0923 19:44:42.343033 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.343038 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.343143 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.343210 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:42.343964 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.345039 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.350616 (+ 5577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.351875 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.352045 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.352117 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.352485 (+ 368us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.352638 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:44:42.353564 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.332028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:35431 (local address 127.13.88.194:60467)
0923 19:44:42.342668 (+ 10640us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:42.342689 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:42.342867 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:42.343487 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:42.343491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:42.343518 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:42.343796 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.343810 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.348584 (+ 4774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.348589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.350431 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:42.350444 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.352041 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.352047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:42.352235 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.352274 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:44:42.353070 (+ 796us) client_negotiation.cc:240] Negotiation successful
0923 19:44:42.353208 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10534,"thread_start_us":15717,"threads_started":1}
I20260923 19:44:42.353785 26960 raft_consensus.cc:2454] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 341ae6c777df4733b5316e6955bc5a13 in term 1.
I20260923 19:44:42.354243 26759 leader_election.cc:302] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 341ae6c777df4733b5316e6955bc5a13, ba4e4908ea2e4a0da5c146bd13758580; no voters:
I20260923 19:44:42.354529 27042 raft_consensus.cc:2781] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:44:42.354911 26682 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b29a69dc0a4775af37cbaa863a057e" candidate_uuid: "341ae6c777df4733b5316e6955bc5a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" is_pre_election: true
I20260923 19:44:42.355345 27042 raft_consensus.cc:686] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 1 LEADER]: Becoming Leader. State: Replica: 341ae6c777df4733b5316e6955bc5a13, State: Running, Role: LEADER
I20260923 19:44:42.355494 26682 raft_consensus.cc:2454] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 341ae6c777df4733b5316e6955bc5a13 in term 0.
I20260923 19:44:42.356005 26681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7b29a69dc0a4775af37cbaa863a057e" candidate_uuid: "341ae6c777df4733b5316e6955bc5a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19"
I20260923 19:44:42.356222 26681 raft_consensus.cc:3037] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:42.356415 27042 consensus_queue.cc:237] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } }
I20260923 19:44:42.358510 26681 raft_consensus.cc:2454] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 341ae6c777df4733b5316e6955bc5a13 in term 1.
I20260923 19:44:42.361404 26529 catalog_manager.cc:5495] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 341ae6c777df4733b5316e6955bc5a13 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "341ae6c777df4733b5316e6955bc5a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "341ae6c777df4733b5316e6955bc5a13" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 38371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 } health_report { overall_health: UNKNOWN } } }
I20260923 19:44:42.402335 27024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.396316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48128 (local address 127.13.88.194:38371)
0923 19:44:42.396522 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.396528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.396549 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:44:42.396745 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.396751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.396857 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.397016 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:44:42.397348 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.398467 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.399855 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.400502 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.400635 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.401095 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:44:42.401767 (+ 672us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:44:42.401940 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.401987 (+ 47us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.402068 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:44:42.411644 26681 raft_consensus.cc:1261] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 1 FOLLOWER]: Refusing update from remote peer 341ae6c777df4733b5316e6955bc5a13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:42.411727 26960 raft_consensus.cc:1261] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 1 FOLLOWER]: Refusing update from remote peer 341ae6c777df4733b5316e6955bc5a13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:42.412714 27045 consensus_queue.cc:1035] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba4e4908ea2e4a0da5c146bd13758580" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 34709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:42.413084 27042 consensus_queue.cc:1035] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "261fa5dfa4204bb0b4f67a2bb90bee19" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:42.424765 27048 mvcc.cc:205] Tried to move back new op lower bound from 7332629227147776000 to 7332629226936102912. Current Snapshot: MvccSnapshot[applied={T|T < 7332629227147776000}]
I20260923 19:44:42.439056 26529 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:44:42.439391 26529 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:44:42.442653 26529 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 586919f0e87b4699b85592a0410412d2: Sending DeleteTablet for 3 replicas of tablet c7b29a69dc0a4775af37cbaa863a057e
I20260923 19:44:42.443780 26806 tablet_service.cc:1514] Processing DeleteTablet for tablet c7b29a69dc0a4775af37cbaa863a057e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:42 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:48116
I20260923 19:44:42.443773 26940 tablet_service.cc:1514] Processing DeleteTablet for tablet c7b29a69dc0a4775af37cbaa863a057e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:42 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:42978
I20260923 19:44:42.445087 26662 tablet_service.cc:1514] Processing DeleteTablet for tablet c7b29a69dc0a4775af37cbaa863a057e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:42 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:41812
I20260923 19:44:42.450054 27060 tablet_replica.cc:330] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: stopping tablet replica
I20260923 19:44:42.450506 27060 raft_consensus.cc:2229] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:44:42.451129 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 26567
I20260923 19:44:42.451335 27058 tablet_replica.cc:330] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: stopping tablet replica
I20260923 19:44:42.451743 27058 raft_consensus.cc:2229] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:44:42.452382 27060 raft_consensus.cc:2258] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:42.453622 27058 raft_consensus.cc:2258] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:42.454339 27059 tablet_replica.cc:330] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: stopping tablet replica
I20260923 19:44:42.454813 27059 raft_consensus.cc:2229] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:44:42.454870 27060 ts_tablet_manager.cc:1905] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:42.455502 27059 raft_consensus.cc:2258] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:42.457659 27059 ts_tablet_manager.cc:1905] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:42.457669 27058 ts_tablet_manager.cc:1905] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:42.464679 27058 ts_tablet_manager.cc:1918] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:44:42.464903 27058 log.cc:1196] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/c7b29a69dc0a4775af37cbaa863a057e
I20260923 19:44:42.465507 27058 ts_tablet_manager.cc:1939] T c7b29a69dc0a4775af37cbaa863a057e P 341ae6c777df4733b5316e6955bc5a13: Deleting consensus metadata
I20260923 19:44:42.467278 26515 catalog_manager.cc:4841] TS 341ae6c777df4733b5316e6955bc5a13 (127.13.88.194:38371): tablet c7b29a69dc0a4775af37cbaa863a057e (table test-table [id=3f3aa423eaa542aba57891a371e3f917]) successfully deleted
I20260923 19:44:42.468714 27060 ts_tablet_manager.cc:1918] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:44:42.468952 27060 log.cc:1196] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/c7b29a69dc0a4775af37cbaa863a057e
I20260923 19:44:42.469023 27059 ts_tablet_manager.cc:1918] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:44:42.469213 27059 log.cc:1196] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/c7b29a69dc0a4775af37cbaa863a057e
I20260923 19:44:42.469559 27060 ts_tablet_manager.cc:1939] T c7b29a69dc0a4775af37cbaa863a057e P 261fa5dfa4204bb0b4f67a2bb90bee19: Deleting consensus metadata
I20260923 19:44:42.469789 27059 ts_tablet_manager.cc:1939] T c7b29a69dc0a4775af37cbaa863a057e P ba4e4908ea2e4a0da5c146bd13758580: Deleting consensus metadata
I20260923 19:44:42.471240 26515 catalog_manager.cc:4841] TS 261fa5dfa4204bb0b4f67a2bb90bee19 (127.13.88.193:35431): tablet c7b29a69dc0a4775af37cbaa863a057e (table test-table [id=3f3aa423eaa542aba57891a371e3f917]) successfully deleted
I20260923 19:44:42.471251 26516 catalog_manager.cc:4841] TS ba4e4908ea2e4a0da5c146bd13758580 (127.13.88.195:34709): tablet c7b29a69dc0a4775af37cbaa863a057e (table test-table [id=3f3aa423eaa542aba57891a371e3f917]) successfully deleted
I20260923 19:44:42.477730 27027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.452199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41816 (local address 127.13.88.193:35431)
0923 19:44:42.452529 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.452537 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.456606 (+ 4069us) server_negotiation.cc:407] Connection header received
0923 19:44:42.456790 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.456795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.456879 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.456971 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:42.465058 (+ 8087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.466152 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.467995 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.468665 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.468771 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.472216 (+ 3445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:42.472226 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:42.472239 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:42.472272 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:42.474965 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:42.475773 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:42.475781 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:42.475785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:42.475961 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:42.476376 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:42.476379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:42.476381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:42.476692 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:42.476906 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.477249 (+ 343us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.477414 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200}
I20260923 19:44:42.478350 26720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:42.568485 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 26567
I20260923 19:44:42.584753 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 26731
I20260923 19:44:42.599850 27024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.585549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48130 (local address 127.13.88.194:38371)
0923 19:44:42.585754 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.585760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.585786 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:44:42.585928 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.585934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.586019 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.586129 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:42.587364 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.588510 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.589779 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.590487 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.590621 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.593105 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:42.593122 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:42.593141 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:42.593178 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:42.597086 (+ 3908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:42.597719 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:42.597728 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:42.597731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:42.597916 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:42.598226 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:42.598232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:42.598235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:42.598703 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:42.599015 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.599219 (+ 204us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.599454 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:44:42.600503 26866 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:42.713459 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 26731
I20260923 19:44:42.732255 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 26875
I20260923 19:44:42.745457 27022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:42.733029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42992 (local address 127.13.88.195:34709)
0923 19:44:42.733210 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:42.733217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:42.733273 (+ 56us) server_negotiation.cc:407] Connection header received
0923 19:44:42.733493 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:42.733497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:42.733557 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:42.733676 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:42.735030 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.735805 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.737186 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:42.737650 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:42.737783 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:42.740268 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:42.740289 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:42.740305 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:42.740334 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:42.742759 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:42.743485 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:42.743493 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:42.743497 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:42.743630 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:42.743974 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:42.743980 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:42.743983 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:42.744316 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:42.744624 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:42.744922 (+ 298us) server_negotiation.cc:299] Negotiation successful
0923 19:44:42.745120 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:44:42.746073 27001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:42.833336 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 26875
I20260923 19:44:42.849372 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 26497
I20260923 19:44:42.850456 26560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:42.959812 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 26497
I20260923 19:44:42.983547 13667 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 19:44:43.319950 13667 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 19:44:43.320135 13667 mini_ranger.cc:66] Stopping Ranger...
I20260923 19:44:43.666531 13667 mini_ranger.cc:68] Stopped Ranger
2026-09-23 19:44:43.666 UTC [25549] LOG: received smart shutdown request
2026-09-23 19:44:43.669 UTC [25549] LOG: background worker "logical replication launcher" (PID 25558) exited with exit code 1
2026-09-23 19:44:43.670 UTC [25553] LOG: shutting down
2026-09-23 19:44:43.816 UTC [25549] LOG: database system is shut down
2026-09-23T19:44:43Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50870 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:44:44 dist-test-slave-xg7f krb5kdc[27074](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:44:44 dist-test-slave-xg7f krb5kdc[27074](info): set up 2 sockets
Sep 23 19:44:44 dist-test-slave-xg7f krb5kdc[27074](info): commencing operation
krb5kdc: starting...
W20260923 19:44:45.015606 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:44:45 dist-test-slave-xg7f krb5kdc[27074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:44:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:44:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:44:45.234210 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43399
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43399,127.13.88.253:34587,127.13.88.252:46541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:45.548669 27087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:45.548936 27087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:45.549127 27087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:45.556074 27087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:45.556167 27087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:45.556277 27087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:45.556388 27087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:45.556470 27087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:45.566246 27087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43399,127.13.88.253:34587,127.13.88.252:46541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:45.567600 27087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:45.569132 27087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:45.581387 27092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:45.581359 27095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:45.581429 27093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:45.582481 27087 server_base.cc:1034] running on GCE node
I20260923 19:44:45.583271 27087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:45.584630 27087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:45.585867 27087 hybrid_clock.cc:648] HybridClock initialized: now 1790192685585828 us; error 50 us; skew 500 ppm
I20260923 19:44:45.586221 27087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:45 dist-test-slave-xg7f krb5kdc[27074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:45.589221 27087 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:44:45.590685 27087 webserver.cc:460] Webserver started at http://127.13.88.254:42745/ using document root <none> and password file <none>
I20260923 19:44:45.591456 27087 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:45.591598 27087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:45.591899 27087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:45.594802 27087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "7bbe107614d545cb84d41aef6acd1fb3"
format_stamp: "Formatted at 2026-09-23 19:44:45 on dist-test-slave-xg7f"
server_key: "330d429c3f7c09ea7a926137244ba459"
server_key_iv: "4436958211a2877c8a8f2fcdf8688035"
server_key_version: "encryptionkey@0"
I20260923 19:44:45.595682 27087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "7bbe107614d545cb84d41aef6acd1fb3"
format_stamp: "Formatted at 2026-09-23 19:44:45 on dist-test-slave-xg7f"
server_key: "330d429c3f7c09ea7a926137244ba459"
server_key_iv: "4436958211a2877c8a8f2fcdf8688035"
server_key_version: "encryptionkey@0"
I20260923 19:44:45.600698 27087 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:44:45.603909 27102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:45.605194 27087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:44:45.605391 27087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "7bbe107614d545cb84d41aef6acd1fb3"
format_stamp: "Formatted at 2026-09-23 19:44:45 on dist-test-slave-xg7f"
server_key: "330d429c3f7c09ea7a926137244ba459"
server_key_iv: "4436958211a2877c8a8f2fcdf8688035"
server_key_version: "encryptionkey@0"
I20260923 19:44:45.605576 27087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:45.629815 27087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:45.634115 27087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:45.634502 27087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:45.653801 27087 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:43399
I20260923 19:44:45.653822 27153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:43399 every 8 connection(s)
I20260923 19:44:45.655192 27087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:44:45.658783 27154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:45.664350 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27087
I20260923 19:44:45.664580 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:44:45.665431 13667 external_mini_cluster.cc:1428] Setting key 192768b6155623c050b84b1d0e618e73
I20260923 19:44:45.666078 27154 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:44:45 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.253@KRBTEST.COM" created.
I20260923 19:44:45.691313 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.670179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43399 (local address 127.0.0.1:46058)
0923 19:44:45.671935 (+ 1756us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.672003 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:45.674147 (+ 2144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:45.675244 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:45.675254 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:45.676055 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:45.676531 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:45.676556 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:45.678105 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:45.678113 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:45.680075 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:45.680093 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:45.680972 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:45.680981 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:45.681189 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:45.681849 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:45.681882 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:45.684575 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:45.687590 (+ 3015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:45.687603 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:45.687613 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:45.687979 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:45.688429 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:45.688435 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:45.688439 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:45.688588 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:45.689357 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:45.689367 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:45.689547 (+ 180us) client_negotiation.cc:769] Sending connection context
0923 19:44:45.689748 (+ 201us) client_negotiation.cc:240] Negotiation successful
0923 19:44:45.690134 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1456,"thread_start_us":516,"threads_started":1}
I20260923 19:44:45.691358 27157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.671745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46058 (local address 127.13.88.254:43399)
0923 19:44:45.673302 (+ 1557us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:45.673315 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:45.673384 (+ 69us) server_negotiation.cc:407] Connection header received
0923 19:44:45.674586 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:45.674596 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:45.674930 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:45.675184 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:45.676715 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:45.677946 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:45.680209 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:45.680730 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:45.680865 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:45.684802 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:45.684809 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:45.684819 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:45.684845 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:45.687476 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:45.688133 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:45.688145 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:45.688147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:45.688321 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:45.688696 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:45.688701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:45.688704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:45.689216 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:45.689403 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:45.689941 (+ 538us) server_negotiation.cc:299] Negotiation successful
0923 19:44:45.690264 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":1359,"thread_start_us":1335,"threads_started":1}
I20260923 19:44:45.694129 27154 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:44:45.695077 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.694738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34356)
0923 19:44:45.694883 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.694982 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 19:44:45.695333 27103 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
I20260923 19:44:45.696833 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.696517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34368)
0923 19:44:45.696670 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.696738 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:44:45.697016 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:34587: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab.
Entry for principal kudu/127.13.88.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab.
I20260923 19:44:45.715477 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:34587
--webserver_interface=127.13.88.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab
--principal=kudu/127.13.88.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43399,127.13.88.253:34587,127.13.88.252:46541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:45.746357 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } attempt: 1
I20260923 19:44:45.747665 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.747086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34382)
0923 19:44:45.747355 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.747483 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260923 19:44:45.748684 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.748312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34392)
0923 19:44:45.748459 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.748541 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260923 19:44:45.748869 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:34587: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
I20260923 19:44:45.817173 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } attempt: 2
I20260923 19:44:45.818554 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.817923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34400)
0923 19:44:45.818236 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.818356 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260923 19:44:45.819703 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.819303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34410)
0923 19:44:45.819452 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.819553 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:44:45.819891 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:34587: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
I20260923 19:44:45.911203 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } attempt: 3
I20260923 19:44:45.912446 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.911948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34426)
0923 19:44:45.912170 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.912281 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260923 19:44:45.913643 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:45.913163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34432)
0923 19:44:45.913343 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:45.913458 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 19:44:45.913868 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:34587: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
W20260923 19:44:46.035100 27161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:46.035511 27161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:46.035699 27161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:46.042817 27161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:46.042972 27161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:46.043079 27161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:46.043195 27161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:46.043246 27161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:46.053134 27161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43399,127.13.88.253:34587,127.13.88.252:46541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab
--principal=kudu/127.13.88.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.88.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:46.054461 27161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:46.055814 27161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 19:44:46.057148 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } attempt: 4
I20260923 19:44:46.058419 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.057800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34436)
0923 19:44:46.058145 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.058253 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260923 19:44:46.059504 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.059056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34444)
0923 19:44:46.059237 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.059346 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260923 19:44:46.059686 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:34587: Network error: Client connection negotiation failed: client connection to 127.13.88.253:34587: connect: Connection refused (error 111)
W20260923 19:44:46.068038 27166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:46.068009 27167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:46.068080 27169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:46.069454 27161 server_base.cc:1034] running on GCE node
I20260923 19:44:46.070192 27161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:46.071624 27161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:46.072854 27161 hybrid_clock.cc:648] HybridClock initialized: now 1790192686072810 us; error 54 us; skew 500 ppm
I20260923 19:44:46.073215 27161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:46.079475 27161 init.cc:377] Logged in from keytab as kudu/127.13.88.253@KRBTEST.COM (short username kudu)
I20260923 19:44:46.081099 27161 webserver.cc:460] Webserver started at http://127.13.88.253:42357/ using document root <none> and password file <none>
I20260923 19:44:46.081835 27161 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:46.081982 27161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:46.082294 27161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:46.085317 27161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data/instance:
uuid: "86bc14b6e2134678822bd3a338e7d575"
format_stamp: "Formatted at 2026-09-23 19:44:46 on dist-test-slave-xg7f"
server_key: "aa4a9936772c57842fa9d0dfa0239079"
server_key_iv: "0fbf9a1027c266b321f249203376ee11"
server_key_version: "encryptionkey@0"
I20260923 19:44:46.086133 27161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/wal/instance:
uuid: "86bc14b6e2134678822bd3a338e7d575"
format_stamp: "Formatted at 2026-09-23 19:44:46 on dist-test-slave-xg7f"
server_key: "aa4a9936772c57842fa9d0dfa0239079"
server_key_iv: "0fbf9a1027c266b321f249203376ee11"
server_key_version: "encryptionkey@0"
I20260923 19:44:46.091573 27161 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260923 19:44:46.095070 27176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:46.096480 27161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:44:46.096669 27161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/wal
uuid: "86bc14b6e2134678822bd3a338e7d575"
format_stamp: "Formatted at 2026-09-23 19:44:46 on dist-test-slave-xg7f"
server_key: "aa4a9936772c57842fa9d0dfa0239079"
server_key_iv: "0fbf9a1027c266b321f249203376ee11"
server_key_version: "encryptionkey@0"
I20260923 19:44:46.096879 27161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:46.113355 27161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:46.117482 27161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:46.117794 27161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:46.136703 27161 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.253:34587
I20260923 19:44:46.136741 27227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.253:34587 every 8 connection(s)
I20260923 19:44:46.138172 27161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
I20260923 19:44:46.141804 27228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:46.145102 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27161
I20260923 19:44:46.145306 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-1/wal/instance
I20260923 19:44:46.145807 13667 external_mini_cluster.cc:1428] Setting key 8060b31c5d067dae0583faf58a09ba53
I20260923 19:44:46.150333 27228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.252@KRBTEST.COM" created.
I20260923 19:44:46.174018 27157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.153744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46064 (local address 127.13.88.254:43399)
0923 19:44:46.153968 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.153975 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.155319 (+ 1344us) server_negotiation.cc:407] Connection header received
0923 19:44:46.157132 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.157137 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.157224 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.157334 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.158786 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.159504 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.161768 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.162508 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.162625 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.167671 (+ 5046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.167680 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.167688 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.167738 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.170997 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.171745 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.171752 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.171756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.171884 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.172300 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.172305 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.172308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.172605 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.172760 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.173479 (+ 719us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.173708 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 19:44:46.174976 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.154281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43399 (local address 127.0.0.1:46064)
0923 19:44:46.155157 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.155200 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.156862 (+ 1662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.157585 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.157593 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.158083 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.158607 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.158623 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.159665 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.159669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.161566 (+ 1897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.161611 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.162990 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.163000 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.163335 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.164191 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.164225 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.167371 (+ 3146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.171165 (+ 3794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.171174 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.171190 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.171622 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.171995 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.172001 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.172004 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.172182 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.172744 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.172751 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.173108 (+ 357us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.173364 (+ 256us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.173845 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":346,"threads_started":1}
I20260923 19:44:46.176919 27228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:44:46.192366 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.177743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34452)
0923 19:44:46.177983 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.178005 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.178103 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.179187 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.179190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.179524 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.179658 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.179666 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.181749 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.181752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.182551 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.182561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.183845 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.183849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.184027 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.184587 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.184604 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.186766 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.189846 (+ 3080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.189854 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.189859 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.190203 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.190564 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.190571 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.190574 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.190705 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.191413 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.191418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.191559 (+ 141us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.191718 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.191974 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"mutex_wait_us":6}
I20260923 19:44:46.192474 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.177911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34452 (local address 127.13.88.253:34587)
0923 19:44:46.178649 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.178659 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.178692 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:44:46.178746 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.178756 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.178986 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.179172 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.179807 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.181619 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.182688 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.183702 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.183844 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.186972 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.186983 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.186996 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.187027 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.189722 (+ 2695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.190336 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.190346 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.190349 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.190464 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.190803 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.190811 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.190814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.191270 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.191551 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.191881 (+ 330us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.192088 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":397,"threads_started":1}
I20260923 19:44:46.194967 27228 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:44:46.196229 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.195757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33012)
0923 19:44:46.195924 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.196025 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 19:44:46.196553 27180 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab.
Entry for principal kudu/127.13.88.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab.
I20260923 19:44:46.197808 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:46541
--webserver_interface=127.13.88.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab
--principal=kudu/127.13.88.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43399,127.13.88.253:34587,127.13.88.252:46541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:46.198161 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.197838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33022)
0923 19:44:46.197979 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.198062 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:44:46.198398 27228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.247732 27228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 1
I20260923 19:44:46.248962 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.248479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33032)
0923 19:44:46.248694 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.248812 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260923 19:44:46.249989 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.249652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33036)
0923 19:44:46.249800 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.249869 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 19:44:46.250236 27228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.318471 27228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 2
I20260923 19:44:46.319712 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.319258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33046)
0923 19:44:46.319456 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.319552 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260923 19:44:46.320863 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.320530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33054)
0923 19:44:46.320662 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.320735 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260923 19:44:46.321183 27228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.358963 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } attempt: 5
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:44:46.372537 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.359757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34458)
0923 19:44:46.359966 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.359990 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.360122 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.360494 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.360500 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.360901 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.361076 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.361084 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.362063 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.362068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.362925 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.362936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.363864 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.363870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.364051 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.364692 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.364709 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.367034 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.370092 (+ 3058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.370098 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.370102 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.370497 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.370873 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.370878 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.370882 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.371021 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.371587 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.371592 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.371751 (+ 159us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.371895 (+ 144us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.372176 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 19:44:46.372531 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.359889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34458 (local address 127.13.88.253:34587)
0923 19:44:46.360100 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.360106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.360128 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:44:46.360241 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.360246 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.360339 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.360449 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.361236 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.361926 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.363072 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.363704 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.363842 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.367266 (+ 3424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.367271 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.367275 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.367312 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.369963 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.370622 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.370629 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.370637 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.370751 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.371151 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.371157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.371162 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.371457 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.371612 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.371991 (+ 379us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.372197 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260923 19:44:46.373756 27154 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:44:46.374957 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.374578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33058)
0923 19:44:46.374745 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.374831 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 19:44:46.376048 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.375711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33074)
0923 19:44:46.375852 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.375915 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260923 19:44:46.376292 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.412395 27228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 3
I20260923 19:44:46.413602 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.413132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33088)
0923 19:44:46.413358 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.413452 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260923 19:44:46.414750 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.414339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33100)
0923 19:44:46.414566 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.414639 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
W20260923 19:44:46.415000 27228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.427511 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 1
I20260923 19:44:46.428499 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.428104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33116)
0923 19:44:46.428277 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.428353 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260923 19:44:46.429443 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.429109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33118)
0923 19:44:46.429263 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.429343 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:44:46.429643 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.498005 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 2
I20260923 19:44:46.499192 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.498669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33126)
0923 19:44:46.498873 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.498979 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260923 19:44:46.500191 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.499872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33130)
0923 19:44:46.500022 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.500095 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260923 19:44:46.500447 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
W20260923 19:44:46.518992 27235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:46.519345 27235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:46.519520 27235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:46.526391 27235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:46.526479 27235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:46.526585 27235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:46.526684 27235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:46.526768 27235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:46.536520 27235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43399,127.13.88.253:34587,127.13.88.252:46541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab
--principal=kudu/127.13.88.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:46541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.88.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:46.537811 27235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:46.539179 27235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:46.550199 27240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:46.550228 27243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:46.550259 27241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:46.551419 27235 server_base.cc:1034] running on GCE node
I20260923 19:44:46.552107 27235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:46.553359 27235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:46.554587 27235 hybrid_clock.cc:648] HybridClock initialized: now 1790192686554535 us; error 38 us; skew 500 ppm
I20260923 19:44:46.554939 27235 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:46.557876 27235 init.cc:377] Logged in from keytab as kudu/127.13.88.252@KRBTEST.COM (short username kudu)
I20260923 19:44:46.558210 27228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 4
I20260923 19:44:46.559388 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.558849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33144)
0923 19:44:46.559054 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.559185 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260923 19:44:46.559513 27235 webserver.cc:460] Webserver started at http://127.13.88.252:43555/ using document root <none> and password file <none>
I20260923 19:44:46.560186 27235 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:46.560343 27235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:46.560371 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.560022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33146)
0923 19:44:46.560169 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.560238 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:44:46.560571 27228 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.560725 27235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:46.563710 27235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data/instance:
uuid: "d0ef7d74a44049a8acde853409c3a924"
format_stamp: "Formatted at 2026-09-23 19:44:46 on dist-test-slave-xg7f"
server_key: "e6966ba16feeb2ae09ad2cf940643577"
server_key_iv: "a687e6c889e92edd34ca84e1141a7443"
server_key_version: "encryptionkey@0"
I20260923 19:44:46.564514 27235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/wal/instance:
uuid: "d0ef7d74a44049a8acde853409c3a924"
format_stamp: "Formatted at 2026-09-23 19:44:46 on dist-test-slave-xg7f"
server_key: "e6966ba16feeb2ae09ad2cf940643577"
server_key_iv: "a687e6c889e92edd34ca84e1141a7443"
server_key_version: "encryptionkey@0"
I20260923 19:44:46.569444 27235 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260923 19:44:46.572698 27250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:46.573972 27235 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:44:46.574151 27235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/wal
uuid: "d0ef7d74a44049a8acde853409c3a924"
format_stamp: "Formatted at 2026-09-23 19:44:46 on dist-test-slave-xg7f"
server_key: "e6966ba16feeb2ae09ad2cf940643577"
server_key_iv: "a687e6c889e92edd34ca84e1141a7443"
server_key_version: "encryptionkey@0"
I20260923 19:44:46.574347 27235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:46.606678 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 3
I20260923 19:44:46.607851 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.607371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33162)
0923 19:44:46.607604 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.607689 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 19:44:46.608861 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.608474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33176)
0923 19:44:46.608677 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.608745 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260923 19:44:46.609067 27154 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46541: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46541: connect: Connection refused (error 111)
I20260923 19:44:46.609925 27235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:46.613884 27235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:46.614161 27235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:46.632274 27235 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.252:46541
I20260923 19:44:46.632297 27301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.252:46541 every 8 connection(s)
I20260923 19:44:46.633661 27235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
I20260923 19:44:46.637449 27302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:46.638223 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27235
I20260923 19:44:46.638424 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790192489293654-13667-0/minicluster-data/master-2/wal/instance
I20260923 19:44:46.638969 13667 external_mini_cluster.cc:1428] Setting key ccbc418b45c49884238706d36a4e1f5d
I20260923 19:44:46.646747 27302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:46.663877 27305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.641520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33188 (local address 127.13.88.252:46541)
0923 19:44:46.642304 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.642316 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.642361 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:44:46.644444 (+ 2083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.644467 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.644861 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.645280 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.646936 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.648362 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.650029 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.650974 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.651174 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.655861 (+ 4687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.655869 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.655879 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.655916 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.659366 (+ 3450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.660188 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.660203 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.660210 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.660351 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.660707 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.660712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.660715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.661317 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.661606 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.662071 (+ 465us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.662466 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":585,"thread_start_us":383,"threads_started":1}
I20260923 19:44:46.665344 27157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.649199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46068 (local address 127.13.88.254:43399)
0923 19:44:46.649414 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.649420 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.650166 (+ 746us) server_negotiation.cc:407] Connection header received
0923 19:44:46.650334 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.650339 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.650434 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.650534 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.651726 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.652397 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.654002 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.654779 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.654934 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.658847 (+ 3913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.658857 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.658863 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.658911 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.662480 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.663295 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.663300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.663303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.663474 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.663938 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.663942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.663944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.664262 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.664376 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.664945 (+ 569us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.665111 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:44:46.666435 27306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.649202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43399 (local address 127.0.0.1:46068)
0923 19:44:46.649962 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.650014 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.650208 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.650591 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.650595 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.651213 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.651576 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.651584 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.652555 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.652560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.653824 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.653837 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.655002 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.655009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.655206 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.655799 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.655845 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.658639 (+ 2794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.662599 (+ 3960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.662607 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.662612 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.663152 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.663630 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.663634 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.663637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.663778 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.664368 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.664375 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.664574 (+ 199us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.664771 (+ 197us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.665070 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":60,"thread_start_us":395,"threads_started":1}
I20260923 19:44:46.667825 27302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:46.681751 27306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.668585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:34587 (local address 127.0.0.1:34460)
0923 19:44:46.668726 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.668744 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.668826 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.669145 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.669150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.669586 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.669737 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.669747 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.671001 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.671005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.672155 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.672171 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.673141 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.673145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.673286 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.673766 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.673781 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.675819 (+ 2038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.679502 (+ 3683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.679506 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.679508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.679858 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.680233 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.680237 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.680240 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.680440 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.680966 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.680969 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.681128 (+ 159us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.681290 (+ 162us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.681534 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260923 19:44:46.681991 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.668621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34460 (local address 127.13.88.253:34587)
0923 19:44:46.668817 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.668824 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.668846 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:44:46.668955 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.668962 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.669026 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.669099 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.669875 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.670861 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.672323 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.672960 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.673115 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.675981 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.675986 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.675989 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.676020 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.679390 (+ 3370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.679968 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.679974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.679978 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.680131 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.680551 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.680555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.680557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.680852 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.680996 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.681393 (+ 397us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.681614 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:44:46.683084 27302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:44:46.683249 27157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.667048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46076 (local address 127.13.88.254:43399)
0923 19:44:46.667235 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.667241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.667257 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:44:46.667300 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.667304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.667383 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.667472 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.668917 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.669999 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.671627 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.672231 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.672345 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.676847 (+ 4502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.676852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.676857 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.676895 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.680092 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.680846 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.680850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.680853 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.680996 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.681428 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.681433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.681436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.681794 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.682070 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.682594 (+ 524us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.682786 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:44:46.696058 27306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.683778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33192)
0923 19:44:46.683956 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.683976 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.684077 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.684435 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.684438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.684859 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.685051 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.685063 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.685903 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.685910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.687301 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.687313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.688188 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.688197 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.688433 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.688921 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.688942 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.691068 (+ 2126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.693889 (+ 2821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.693895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.693902 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.694221 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.694551 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.694558 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.694564 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.694685 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.695153 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.695157 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.695288 (+ 131us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.695440 (+ 152us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.695716 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 19:44:46.696122 27305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.683949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33192 (local address 127.13.88.252:46541)
0923 19:44:46.684084 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.684088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.684101 (+ 13us) server_negotiation.cc:407] Connection header received
0923 19:44:46.684165 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.684168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.684215 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.684285 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.685175 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.685780 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.687432 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.688065 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.688145 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.691276 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.691281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.691284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.691327 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.693770 (+ 2443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.694332 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.694340 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.694343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.694454 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.694779 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.694786 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.694789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.695025 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.695186 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.695516 (+ 330us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.695843 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":140,"server-negotiator.queue_time_us":50}
I20260923 19:44:46.699365 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.685060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34474 (local address 127.13.88.253:34587)
0923 19:44:46.685294 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.685299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.685316 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:44:46.685365 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.685370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.685426 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.685530 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.686940 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.687909 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.689573 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.689959 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.690072 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.694374 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.694379 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.694384 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.694421 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.696987 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.697562 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.697569 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.697582 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.697701 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.698054 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.698060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.698063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.698308 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.698564 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.698838 (+ 274us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.699050 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260923 19:44:46.700901 27302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924: Bootstrap starting.
I20260923 19:44:46.703765 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:44:46.704516 27302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:46.705511 27302 log.cc:824] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:46.708586 27302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924: No bootstrap required, opened a new log
I20260923 19:44:46.724306 27302 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:46.724998 27302 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:46.725189 27302 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0ef7d74a44049a8acde853409c3a924, State: Initialized, Role: FOLLOWER
I20260923 19:44:46.726174 27302 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:46.732862 27315 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:46.734097 27302 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:46.734762 27315 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:44:46.748982 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.708588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34488 (local address 127.13.88.253:34587)
0923 19:44:46.708948 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.708957 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.728161 (+ 19204us) server_negotiation.cc:407] Connection header received
0923 19:44:46.728354 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.728361 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.728450 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.728543 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.730756 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.731851 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.733815 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.734403 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.734496 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.738634 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.738643 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.738650 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.738701 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.743042 (+ 4341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.746666 (+ 3624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.746673 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.746677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.746812 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.747278 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.747283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.747287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.747664 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.747899 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.748424 (+ 525us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.748641 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219}
I20260923 19:44:46.749405 27305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.708581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33198 (local address 127.13.88.252:46541)
0923 19:44:46.708777 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.708783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.727283 (+ 18500us) server_negotiation.cc:407] Connection header received
0923 19:44:46.727602 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.727610 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.727690 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.727754 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.730498 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.731672 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.735465 (+ 3793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.736269 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.736387 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.740883 (+ 4496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.740892 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.740899 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.740942 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.745227 (+ 4285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.746610 (+ 1383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.746617 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.746623 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.746801 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.747278 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.747283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.747286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.747680 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.748730 (+ 1050us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.748845 (+ 115us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.749082 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260923 19:44:46.751003 27157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.711319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46080 (local address 127.13.88.254:43399)
0923 19:44:46.711600 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.711609 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.728943 (+ 17334us) server_negotiation.cc:407] Connection header received
0923 19:44:46.729145 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.729153 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.729258 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.729368 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.732351 (+ 2983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.733323 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.735116 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.735720 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.735866 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.740604 (+ 4738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.740611 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.740617 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.740675 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.745556 (+ 4881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.746849 (+ 1293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.746858 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.746864 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.747080 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.747621 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.747629 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.747635 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.748088 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.748366 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.749242 (+ 876us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.749548 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
W20260923 19:44:46.763986 27326 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:44:46.764132 27326 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:44:46.760555 27235 master_runner.cc:186] Error getting master registration for 127.13.88.254:43399: OK, instance_id { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" instance_seqno: 1790192685648668 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:44:46.771696 27235 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:44:46.786260 27154 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 4
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192685, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
I20260923 19:44:46.800007 27305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.786839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33200 (local address 127.13.88.252:46541)
0923 19:44:46.787008 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.787016 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.787119 (+ 103us) server_negotiation.cc:407] Connection header received
0923 19:44:46.787327 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.787332 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.787423 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.787527 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.788251 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.789026 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.790226 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.790705 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.790849 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.794651 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.794657 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.794662 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.794696 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.797429 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.798057 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.798062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.798066 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.798197 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.798569 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.798580 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.798584 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.798847 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.799003 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.799421 (+ 418us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.799652 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:44:46.800026 27156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.786808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33200)
0923 19:44:46.787001 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.787021 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.787206 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.787550 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.787554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.787950 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.788106 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.788115 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.789156 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.789164 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.790089 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.790099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.790852 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.790858 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.791135 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.791739 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.791756 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.794472 (+ 2716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.797576 (+ 3104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.797583 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.797587 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.797933 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.798302 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.798308 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.798311 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.798463 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.798968 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.798973 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.799193 (+ 220us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.799333 (+ 140us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.799637 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260923 19:44:46.805379 27154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: Bootstrap starting.
I20260923 19:44:46.808612 27154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:46.809644 27154 log.cc:824] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:46.812412 27154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: No bootstrap required, opened a new log
I20260923 19:44:46.819634 27154 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:46.819916 27154 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:46.820067 27154 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bbe107614d545cb84d41aef6acd1fb3, State: Initialized, Role: FOLLOWER
I20260923 19:44:46.820601 27154 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:46.821529 27329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:46.821909 27329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:44:46.822642 27154 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:44:46.832746 27340 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:44:46.832937 27340 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:44:46.832288 27087 master_runner.cc:186] Error getting master registration for 127.13.88.253:34587: OK, instance_id { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" instance_seqno: 1790192686131248 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:44:46.843623 27087 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:44:46.859784 27228 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } attempt: 5
W20260923 19:44:46.866319 27256 tablet.cc:2369] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 19:44:46 dist-test-slave-xg7f krb5kdc[27074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192686, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
I20260923 19:44:46.878579 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.860352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46541 (local address 127.0.0.1:33206)
0923 19:44:46.860623 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:46.860647 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:46.860770 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:46.861155 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:46.861160 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:46.861680 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:46.861902 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.861915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.863493 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.863502 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.864944 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:46.864959 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.865962 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.865968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:46.866193 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.866866 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:46.866892 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:46.869680 (+ 2788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:46.875752 (+ 6072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.875758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.875762 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.876298 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.876672 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:46.876679 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:46.876683 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:46.876846 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:46.877585 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:46.877590 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:46.877752 (+ 162us) client_negotiation.cc:769] Sending connection context
0923 19:44:46.877920 (+ 168us) client_negotiation.cc:240] Negotiation successful
0923 19:44:46.878201 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260923 19:44:46.878963 27305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:46.860438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33206 (local address 127.13.88.252:46541)
0923 19:44:46.860625 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:46.860632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:46.860728 (+ 96us) server_negotiation.cc:407] Connection header received
0923 19:44:46.860910 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:46.860916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:46.860992 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:46.861111 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:46.862060 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.863266 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.865098 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:46.865802 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:46.865931 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:46.869900 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:46.869909 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:46.869914 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:46.869952 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:46.875620 (+ 5668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.876411 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.876416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.876420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.876556 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:46.876954 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:46.876959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:46.876963 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:46.877363 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:46.877522 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:46.878083 (+ 561us) server_negotiation.cc:299] Negotiation successful
0923 19:44:46.878329 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:44:46.884927 27228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: Bootstrap starting.
W20260923 19:44:46.888535 27108 tablet.cc:2369] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:44:46.889168 27228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:46.890501 27228 log.cc:824] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:46.895449 27228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: No bootstrap required, opened a new log
I20260923 19:44:46.906323 27228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:46.906692 27228 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:46.906805 27228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bc14b6e2134678822bd3a338e7d575, State: Initialized, Role: FOLLOWER
I20260923 19:44:46.907541 27228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:46.910358 27343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:46.910770 27343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:44:46.911944 27228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:46.932395 27161 master_runner.cc:263] No leader master found from master 86bc14b6e2134678822bd3a338e7d575
I20260923 19:44:46.932566 27161 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260923 19:44:46.933097 27354 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:44:46.933234 27354 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:44:47.088234 27315 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:44:47.088557 27315 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:47.090140 27315 leader_election.cc:288] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bbe107614d545cb84d41aef6acd1fb3 (127.13.88.254:43399), 86bc14b6e2134678822bd3a338e7d575 (127.13.88.253:34587)
I20260923 19:44:47.091236 27129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0ef7d74a44049a8acde853409c3a924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bbe107614d545cb84d41aef6acd1fb3" is_pre_election: true
I20260923 19:44:47.091866 27129 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ef7d74a44049a8acde853409c3a924 in term 0.
I20260923 19:44:47.093149 27203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0ef7d74a44049a8acde853409c3a924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bc14b6e2134678822bd3a338e7d575" is_pre_election: true
I20260923 19:44:47.093737 27203 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0ef7d74a44049a8acde853409c3a924 in term 0.
I20260923 19:44:47.094566 27253 leader_election.cc:302] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7bbe107614d545cb84d41aef6acd1fb3, d0ef7d74a44049a8acde853409c3a924; no voters:
I20260923 19:44:47.095047 27315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:44:47.095293 27315 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:44:47.095398 27315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:47.098655 27315 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:47.100731 27129 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0ef7d74a44049a8acde853409c3a924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bbe107614d545cb84d41aef6acd1fb3"
I20260923 19:44:47.100983 27129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:47.104766 27129 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ef7d74a44049a8acde853409c3a924 in term 1.
I20260923 19:44:47.104920 27315 leader_election.cc:288] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [CANDIDATE]: Term 1 election: Requested vote from peers 7bbe107614d545cb84d41aef6acd1fb3 (127.13.88.254:43399), 86bc14b6e2134678822bd3a338e7d575 (127.13.88.253:34587)
I20260923 19:44:47.105520 27203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d0ef7d74a44049a8acde853409c3a924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bc14b6e2134678822bd3a338e7d575"
I20260923 19:44:47.105754 27203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:47.109434 27203 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0ef7d74a44049a8acde853409c3a924 in term 1.
I20260923 19:44:47.109970 27251 leader_election.cc:302] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bc14b6e2134678822bd3a338e7d575, d0ef7d74a44049a8acde853409c3a924; no voters:
I20260923 19:44:47.110417 27315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:44:47.120431 27182 tablet.cc:2369] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:44:47.122319 27315 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [term 1 LEADER]: Becoming Leader. State: Replica: d0ef7d74a44049a8acde853409c3a924, State: Running, Role: LEADER
I20260923 19:44:47.123180 27315 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } }
I20260923 19:44:47.133394 27356 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ef7d74a44049a8acde853409c3a924. Latest consensus state: current_term: 1 leader_uuid: "d0ef7d74a44049a8acde853409c3a924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:47.133912 27356 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:47.154932 27358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:44:47.157555 27358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:44:47.178819 27203 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [term 1 FOLLOWER]: Refusing update from remote peer d0ef7d74a44049a8acde853409c3a924: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:47.180070 27356 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:47.187357 27129 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [term 1 FOLLOWER]: Refusing update from remote peer d0ef7d74a44049a8acde853409c3a924: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:47.188253 27356 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:47.208388 27343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ef7d74a44049a8acde853409c3a924. Latest consensus state: current_term: 1 leader_uuid: "d0ef7d74a44049a8acde853409c3a924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:47.208722 27343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:44:47.217029 27359 mvcc.cc:205] Tried to move back new op lower bound from 7332629246670925824 to 7332629246463672320. Current Snapshot: MvccSnapshot[applied={T|T < 7332629246670925824}]
I20260923 19:44:47.218569 27360 mvcc.cc:205] Tried to move back new op lower bound from 7332629246670925824 to 7332629246463672320. Current Snapshot: MvccSnapshot[applied={T|T < 7332629246670925824}]
I20260923 19:44:47.227542 27315 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0ef7d74a44049a8acde853409c3a924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:47.227877 27315 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:47.230036 27343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0ef7d74a44049a8acde853409c3a924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:47.230290 27343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:44:47.232676 27358 catalog_manager.cc:1347] Generated new cluster ID: f898965776824d0f8ed4b816ebd8133c
I20260923 19:44:47.232800 27358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:44:47.248054 27329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0ef7d74a44049a8acde853409c3a924. Latest consensus state: current_term: 1 leader_uuid: "d0ef7d74a44049a8acde853409c3a924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:47.248368 27329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:44:47.250288 27356 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d0ef7d74a44049a8acde853409c3a924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:47.250573 27356 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:47.252718 27361 mvcc.cc:205] Tried to move back new op lower bound from 7332629246670925824 to 7332629246463672320. Current Snapshot: MvccSnapshot[applied={T|T < 7332629246670925824}]
I20260923 19:44:47.262897 27329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d0ef7d74a44049a8acde853409c3a924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bbe107614d545cb84d41aef6acd1fb3" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43399 } } peers { permanent_uuid: "86bc14b6e2134678822bd3a338e7d575" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 34587 } } peers { permanent_uuid: "d0ef7d74a44049a8acde853409c3a924" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46541 } } }
I20260923 19:44:47.263216 27329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:44:47.271347 27358 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:44:47.277552 27358 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:44:47.291028 27358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0ef7d74a44049a8acde853409c3a924: Generated new TSK 0
I20260923 19:44:47.292081 27358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:44:47.834847 27340 catalog_manager.cc:1259] Loaded cluster ID: f898965776824d0f8ed4b816ebd8133c
I20260923 19:44:47.834995 27340 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: loading cluster ID for follower catalog manager: success
I20260923 19:44:47.837484 27340 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: acquiring CA information for follower catalog manager: success
I20260923 19:44:47.839217 27340 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7bbe107614d545cb84d41aef6acd1fb3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:44:47.935405 27354 catalog_manager.cc:1259] Loaded cluster ID: f898965776824d0f8ed4b816ebd8133c
I20260923 19:44:47.935527 27354 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: loading cluster ID for follower catalog manager: success
I20260923 19:44:47.937971 27354 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: acquiring CA information for follower catalog manager: success
I20260923 19:44:47.939741 27354 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 86bc14b6e2134678822bd3a338e7d575: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:44:48.393007 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27087
I20260923 19:44:48.394129 27149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:48.503396 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27087
I20260923 19:44:48.524523 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27161
I20260923 19:44:48.525593 27223 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:48.629997 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27161
I20260923 19:44:48.653342 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27235
I20260923 19:44:48.654320 27297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:48.760811 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27235
2026-09-23T19:44:48Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4824 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:44:48 dist-test-slave-xg7f krb5kdc[27376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:44:48 dist-test-slave-xg7f krb5kdc[27376](info): set up 2 sockets
Sep 23 19:44:48 dist-test-slave-xg7f krb5kdc[27376](info): commencing operation
krb5kdc: starting...
W20260923 19:44:49.839696 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:44:49 dist-test-slave-xg7f krb5kdc[27376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:44:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:44:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:44:50.076161 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35981
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:40023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:35981
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:50.390204 27389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:50.390538 27389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:50.390687 27389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:50.397948 27389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:50.398097 27389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:50.398202 27389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:50.398298 27389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:50.398389 27389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:50.408213 27389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:40023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:35981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:50.409575 27389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:50.410909 27389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:50.422574 27394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:50.422591 27395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:50.422628 27397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:50.423555 27389 server_base.cc:1034] running on GCE node
I20260923 19:44:50.424283 27389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:50.425571 27389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:50.426796 27389 hybrid_clock.cc:648] HybridClock initialized: now 1790192690426763 us; error 42 us; skew 500 ppm
I20260923 19:44:50.427165 27389 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:50 dist-test-slave-xg7f krb5kdc[27376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192690, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:50.430009 27389 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:44:50.431445 27389 webserver.cc:460] Webserver started at http://127.13.88.254:42011/ using document root <none> and password file <none>
I20260923 19:44:50.432080 27389 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:50.432220 27389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:50.432525 27389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:50.435288 27389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "6dcc210332c44d659147f55d9587de79"
format_stamp: "Formatted at 2026-09-23 19:44:50 on dist-test-slave-xg7f"
server_key: "0653c440e8f3b6d8a2f066b7f1a1492e"
server_key_iv: "9020f185c022e683c13288bbfd0c306f"
server_key_version: "encryptionkey@0"
I20260923 19:44:50.435979 27389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "6dcc210332c44d659147f55d9587de79"
format_stamp: "Formatted at 2026-09-23 19:44:50 on dist-test-slave-xg7f"
server_key: "0653c440e8f3b6d8a2f066b7f1a1492e"
server_key_iv: "9020f185c022e683c13288bbfd0c306f"
server_key_version: "encryptionkey@0"
I20260923 19:44:50.440898 27389 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:44:50.444115 27404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:50.445374 27389 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:44:50.445564 27389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "6dcc210332c44d659147f55d9587de79"
format_stamp: "Formatted at 2026-09-23 19:44:50 on dist-test-slave-xg7f"
server_key: "0653c440e8f3b6d8a2f066b7f1a1492e"
server_key_iv: "9020f185c022e683c13288bbfd0c306f"
server_key_version: "encryptionkey@0"
I20260923 19:44:50.445749 27389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:50.460481 27389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:50.464056 27389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:50.464325 27389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:50.482115 27389 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:35981
I20260923 19:44:50.482137 27455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:35981 every 8 connection(s)
I20260923 19:44:50.483464 27389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:44:50.486413 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27389
I20260923 19:44:50.486634 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:44:50.487233 27456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:50.487334 13667 external_mini_cluster.cc:1428] Setting key 2c79ee6ac2d99cf288da4c9ddb8b6304
I20260923 19:44:50.501693 27456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79: Bootstrap starting.
Sep 23 19:44:50 dist-test-slave-xg7f krb5kdc[27376](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:50.505026 27456 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:50.506068 27456 log.cc:824] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:50.508742 27456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79: No bootstrap required, opened a new log
I20260923 19:44:50.510272 27459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:50.489056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54998 (local address 127.13.88.254:35981)
0923 19:44:50.489815 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:50.489828 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:50.489869 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:44:50.491787 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:50.491808 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:50.492175 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:50.492489 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:50.494329 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:50.495657 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:50.497556 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:50.498293 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:50.498434 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:50.503363 (+ 4929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:50.503371 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:50.503384 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:50.503421 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:50.506394 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:50.507140 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:50.507150 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:50.507160 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:50.507315 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:50.507701 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:50.507706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:50.507709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:50.508185 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:50.508481 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:50.508910 (+ 429us) server_negotiation.cc:299] Negotiation successful
0923 19:44:50.509348 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":360,"threads_started":1}
I20260923 19:44:50.514300 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:44:50.518519 27456 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dcc210332c44d659147f55d9587de79" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35981 } }
I20260923 19:44:50.518841 27456 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:50.518939 27456 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dcc210332c44d659147f55d9587de79, State: Initialized, Role: FOLLOWER
I20260923 19:44:50.519598 27456 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dcc210332c44d659147f55d9587de79" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35981 } }
I20260923 19:44:50.519825 27456 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:44:50.519950 27456 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:44:50.520125 27456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:50.522297 27456 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dcc210332c44d659147f55d9587de79" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35981 } }
I20260923 19:44:50.522750 27456 leader_election.cc:302] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6dcc210332c44d659147f55d9587de79; no voters:
I20260923 19:44:50.523444 27456 leader_election.cc:288] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:44:50.523547 27461 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:44:50.524194 27461 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [term 1 LEADER]: Becoming Leader. State: Replica: 6dcc210332c44d659147f55d9587de79, State: Running, Role: LEADER
I20260923 19:44:50.524741 27461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dcc210332c44d659147f55d9587de79" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35981 } }
I20260923 19:44:50.525581 27456 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:50.527477 27463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6dcc210332c44d659147f55d9587de79. Latest consensus state: current_term: 1 leader_uuid: "6dcc210332c44d659147f55d9587de79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dcc210332c44d659147f55d9587de79" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35981 } } }
I20260923 19:44:50.527823 27463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:50.528182 27462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6dcc210332c44d659147f55d9587de79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6dcc210332c44d659147f55d9587de79" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35981 } } }
I20260923 19:44:50.528559 27462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:50.530280 27467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:44:50.535588 27467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:44:50.543427 27467 catalog_manager.cc:1347] Generated new cluster ID: b26c75a3c67a4b41a2966fb5ff418f90
I20260923 19:44:50.543522 27467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:44:50.557404 27467 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:44:50.558686 27467 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:44:50.571803 27467 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6dcc210332c44d659147f55d9587de79: Generated new TSK 0
I20260923 19:44:50.572661 27467 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:44:50.627174 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27389
I20260923 19:44:50.628350 27451 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:50.725944 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27389
2026-09-23T19:44:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1961 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:44:50 dist-test-slave-xg7f krb5kdc[27484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:44:50 dist-test-slave-xg7f krb5kdc[27484](info): set up 2 sockets
Sep 23 19:44:50 dist-test-slave-xg7f krb5kdc[27484](info): commencing operation
krb5kdc: starting...
W20260923 19:44:51.807463 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.006s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:44:51 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:44:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:44:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:44:52.032351 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45683
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45683
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:52.357976 27497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:52.358253 27497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:52.358340 27497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:52.365552 27497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:52.365659 27497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:52.365705 27497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:52.365782 27497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:52.365875 27497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:52.375520 27497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:52.376809 27497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:52.378177 27497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:52.390034 27502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:52.390123 27505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:52.390097 27503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:52.390954 27497 server_base.cc:1034] running on GCE node
I20260923 19:44:52.391840 27497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:52.393291 27497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:52.394521 27497 hybrid_clock.cc:648] HybridClock initialized: now 1790192692394485 us; error 48 us; skew 500 ppm
I20260923 19:44:52.394878 27497 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:52 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192692, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:52.401250 27497 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:44:52.402570 27497 webserver.cc:460] Webserver started at http://127.13.88.254:37225/ using document root <none> and password file <none>
I20260923 19:44:52.403264 27497 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:52.403363 27497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:52.403590 27497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:52.406394 27497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "0dd9bc54757a481a86f0d006f08b1223"
format_stamp: "Formatted at 2026-09-23 19:44:52 on dist-test-slave-xg7f"
server_key: "3f097b7319a19da97f4359dd222f35e3"
server_key_iv: "2c63f494b0b12858f452df21d38b5a52"
server_key_version: "encryptionkey@0"
I20260923 19:44:52.407080 27497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "0dd9bc54757a481a86f0d006f08b1223"
format_stamp: "Formatted at 2026-09-23 19:44:52 on dist-test-slave-xg7f"
server_key: "3f097b7319a19da97f4359dd222f35e3"
server_key_iv: "2c63f494b0b12858f452df21d38b5a52"
server_key_version: "encryptionkey@0"
I20260923 19:44:52.412127 27497 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260923 19:44:52.415342 27512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:52.416612 27497 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:44:52.416746 27497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "0dd9bc54757a481a86f0d006f08b1223"
format_stamp: "Formatted at 2026-09-23 19:44:52 on dist-test-slave-xg7f"
server_key: "3f097b7319a19da97f4359dd222f35e3"
server_key_iv: "2c63f494b0b12858f452df21d38b5a52"
server_key_version: "encryptionkey@0"
I20260923 19:44:52.416906 27497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:52.437107 27497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:52.440954 27497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:52.441177 27497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:52.459293 27497 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:45683
I20260923 19:44:52.459342 27563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:45683 every 8 connection(s)
I20260923 19:44:52.460686 27497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:44:52.464433 27564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:52.464556 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27497
I20260923 19:44:52.464777 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:44:52.465409 13667 external_mini_cluster.cc:1428] Setting key 15235159338bb783556973f708051fc9
I20260923 19:44:52.478268 27564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Bootstrap starting.
Sep 23 19:44:52 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:52.481292 27564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:52.482537 27564 log.cc:824] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:52.485672 27564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: No bootstrap required, opened a new log
I20260923 19:44:52.489315 27567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:52.467421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53152 (local address 127.13.88.254:45683)
0923 19:44:52.468202 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:52.468217 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:52.468269 (+ 52us) server_negotiation.cc:407] Connection header received
0923 19:44:52.470852 (+ 2583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:52.470886 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:52.471432 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:52.471879 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:52.473085 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:52.475020 (+ 1935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:52.476270 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:52.477278 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:52.477453 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:52.481364 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:52.481375 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:52.481392 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:52.481433 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:52.485030 (+ 3597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:52.485624 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:52.485632 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:52.485641 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:52.485833 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:52.486164 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:52.486169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:52.486171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:52.486856 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:52.487175 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:52.487551 (+ 376us) server_negotiation.cc:299] Negotiation successful
0923 19:44:52.488003 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":291,"threads_started":1}
I20260923 19:44:52.494714 27564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:52.495033 27564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:52.495150 27564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dd9bc54757a481a86f0d006f08b1223, State: Initialized, Role: FOLLOWER
I20260923 19:44:52.495710 27564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:52.496006 27564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:44:52.496167 27564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:44:52.496346 27564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:52.498459 27564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:52.498939 27564 leader_election.cc:302] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0dd9bc54757a481a86f0d006f08b1223; no voters:
I20260923 19:44:52.499542 27564 leader_election.cc:288] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:44:52.499671 27569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:44:52.500736 27569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 LEADER]: Becoming Leader. State: Replica: 0dd9bc54757a481a86f0d006f08b1223, State: Running, Role: LEADER
I20260923 19:44:52.501291 27569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:52.501621 27564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:52.504053 27570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0dd9bc54757a481a86f0d006f08b1223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } } }
I20260923 19:44:52.503989 27571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0dd9bc54757a481a86f0d006f08b1223. Latest consensus state: current_term: 1 leader_uuid: "0dd9bc54757a481a86f0d006f08b1223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } } }
I20260923 19:44:52.504411 27570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:52.504416 27571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:52.511950 27578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:44:52.517184 27578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:44:52.525516 27578 catalog_manager.cc:1347] Generated new cluster ID: 87436a2185074f2bbcadd21faf79e678
I20260923 19:44:52.525666 27578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:44:52.552619 27578 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:44:52.554382 27578 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:44:52.568519 27578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Generated new TSK 0
I20260923 19:44:52.569417 27578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:44:52.635396 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45683
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:52.965798 27590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:52.966135 27590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:52.966308 27590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:52.973646 27590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:52.973809 27590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:52.973987 27590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:44:52.983599 27590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:52.985087 27590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:52.986464 27590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:52.999200 27595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:52.999269 27596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:53.000119 27598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:53.000212 27590 server_base.cc:1034] running on GCE node
I20260923 19:44:53.000878 27590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:53.001765 27590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:53.003026 27590 hybrid_clock.cc:648] HybridClock initialized: now 1790192693002962 us; error 42 us; skew 500 ppm
I20260923 19:44:53.003384 27590 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:53 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192693, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:53.006558 27590 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:44:53.008172 27590 webserver.cc:460] Webserver started at http://127.13.88.193:39371/ using document root <none> and password file <none>
I20260923 19:44:53.008924 27590 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:53.009068 27590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:53.009330 27590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:53.012337 27590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "e14c99314df9424696ff984ff441a892"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "f6968d9e63d90c7cc98d071e14aa31f5"
server_key_iv: "6d5f4d8c1c014f1dbd5fdfe12932515a"
server_key_version: "encryptionkey@0"
I20260923 19:44:53.013091 27590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "e14c99314df9424696ff984ff441a892"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "f6968d9e63d90c7cc98d071e14aa31f5"
server_key_iv: "6d5f4d8c1c014f1dbd5fdfe12932515a"
server_key_version: "encryptionkey@0"
I20260923 19:44:53.018181 27590 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:44:53.021863 27605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:53.023242 27590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:44:53.023387 27590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "e14c99314df9424696ff984ff441a892"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "f6968d9e63d90c7cc98d071e14aa31f5"
server_key_iv: "6d5f4d8c1c014f1dbd5fdfe12932515a"
server_key_version: "encryptionkey@0"
I20260923 19:44:53.023559 27590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:53.049821 27590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:53.054044 27590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:53.054291 27590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:53.055290 27590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:53.056674 27590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:53.056746 27590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:53.056833 27590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:53.056885 27590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:53.089510 27590 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:38579
I20260923 19:44:53.089551 27717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:38579 every 8 connection(s)
I20260923 19:44:53.090895 27590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:44:53.101035 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27590
I20260923 19:44:53.101275 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:44:53.102164 13667 external_mini_cluster.cc:1428] Setting key dcbca7b449f32656e3a72d343e801bdf
Sep 23 19:44:53 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192693, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:53.112555 27720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:53.093471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:52915 (local address 127.13.88.254:45683)
0923 19:44:53.093906 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:53.093912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:53.094840 (+ 928us) server_negotiation.cc:407] Connection header received
0923 19:44:53.096563 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:53.096567 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:53.096644 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:53.096734 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:53.098189 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.098910 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.100563 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.100942 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.101049 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:53.105278 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:53.105288 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:53.105296 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:53.105343 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:53.109204 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:53.110042 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:53.110051 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:53.110057 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:53.110207 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:53.110627 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:53.110635 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:53.110641 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:53.111035 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:53.111208 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:53.112014 (+ 806us) server_negotiation.cc:299] Negotiation successful
0923 19:44:53.112278 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":199,"threads_started":1}
I20260923 19:44:53.113866 27721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:53.093999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:52915)
0923 19:44:53.094676 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:53.094720 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:53.096316 (+ 1596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:53.096929 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:53.096938 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:53.097489 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:53.098043 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:53.098060 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.099032 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.099035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:53.100331 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:53.100356 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.101194 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.101204 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:53.101525 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:53.102375 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:53.102406 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:53.105047 (+ 2641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:53.109371 (+ 4324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:53.109378 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:53.109393 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:53.109897 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:53.110316 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:53.110319 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:53.110321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:53.110506 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:53.111249 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:53.111257 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:53.111596 (+ 339us) client_negotiation.cc:769] Sending connection context
0923 19:44:53.111839 (+ 243us) client_negotiation.cc:240] Negotiation successful
0923 19:44:53.112319 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":270,"threads_started":1}
I20260923 19:44:53.115540 27718 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45683
I20260923 19:44:53.115897 27718 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:53.116812 27718 heartbeater.cc:511] Master 127.13.88.254:45683 requested a full tablet report, sending...
I20260923 19:44:53.118980 27529 ts_manager.cc:194] Registered new tserver with Master: e14c99314df9424696ff984ff441a892 (127.13.88.193:38579)
I20260923 19:44:53.120625 27529 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:52915
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:44:53.154187 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45683
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:53.472842 27724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:53.473105 27724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:53.473199 27724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:53.480512 27724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:53.480628 27724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:53.480738 27724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:44:53.490218 27724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:53.491631 27724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:53.492942 27724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:53.506306 27729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:53.506347 27732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:53.506399 27730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:53.507092 27724 server_base.cc:1034] running on GCE node
I20260923 19:44:53.507797 27724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:53.508752 27724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:53.509967 27724 hybrid_clock.cc:648] HybridClock initialized: now 1790192693509904 us; error 53 us; skew 500 ppm
I20260923 19:44:53.510275 27724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:53 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192693, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:53.513357 27724 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:44:53.514710 27724 webserver.cc:460] Webserver started at http://127.13.88.194:41679/ using document root <none> and password file <none>
I20260923 19:44:53.515456 27724 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:53.515597 27724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:53.515905 27724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:53.518719 27724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "a905164abbd1474fa36a4af0fdaff117"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "522fd4f69c3cd17bebf4d8e30ffcde40"
server_key_iv: "56e005ba713cc95cfbecbc813af1e4c2"
server_key_version: "encryptionkey@0"
I20260923 19:44:53.519524 27724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "a905164abbd1474fa36a4af0fdaff117"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "522fd4f69c3cd17bebf4d8e30ffcde40"
server_key_iv: "56e005ba713cc95cfbecbc813af1e4c2"
server_key_version: "encryptionkey@0"
I20260923 19:44:53.524632 27724 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:44:53.527971 27739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:53.529351 27724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:44:53.529583 27724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "a905164abbd1474fa36a4af0fdaff117"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "522fd4f69c3cd17bebf4d8e30ffcde40"
server_key_iv: "56e005ba713cc95cfbecbc813af1e4c2"
server_key_version: "encryptionkey@0"
I20260923 19:44:53.529795 27724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:53.546362 27724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:53.550135 27724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:53.550423 27724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:53.551393 27724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:53.552726 27724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:53.552826 27724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:53.552973 27724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:53.553040 27724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:53.585525 27724 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:44089
I20260923 19:44:53.585536 27851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:44089 every 8 connection(s)
I20260923 19:44:53.586795 27724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:44:53.596036 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27724
I20260923 19:44:53.596233 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:44:53.596724 13667 external_mini_cluster.cc:1428] Setting key 7805fedcb616fb51c1def2c925d6f46a
Sep 23 19:44:53 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192693, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:53.606453 27720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:53.589302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:33603 (local address 127.13.88.254:45683)
0923 19:44:53.589486 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:53.589491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:53.590521 (+ 1030us) server_negotiation.cc:407] Connection header received
0923 19:44:53.592272 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:53.592277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:53.592346 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:53.592438 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:53.593813 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.594509 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.596414 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.596873 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.596979 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:53.600647 (+ 3668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:53.600652 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:53.600655 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:53.600686 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:53.603386 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:53.604116 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:53.604124 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:53.604132 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:53.604273 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:53.604706 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:53.604715 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:53.604717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:53.604994 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:53.605158 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:53.605869 (+ 711us) server_negotiation.cc:299] Negotiation successful
0923 19:44:53.606102 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:44:53.607589 27854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:53.589683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:33603)
0923 19:44:53.590345 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:53.590390 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:53.592035 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:53.592664 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:53.592672 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:53.593127 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:53.593658 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:53.593673 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.594665 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.594670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:53.596263 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:53.596279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:53.597128 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:53.597136 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:53.597425 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:53.598107 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:53.598141 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:53.600425 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:53.603536 (+ 3111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:53.603544 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:53.603562 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:53.603990 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:53.604392 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:53.604397 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:53.604400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:53.604584 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:53.605132 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:53.605140 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:53.605493 (+ 353us) client_negotiation.cc:769] Sending connection context
0923 19:44:53.605776 (+ 283us) client_negotiation.cc:240] Negotiation successful
0923 19:44:53.606312 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":258,"threads_started":1}
I20260923 19:44:53.609120 27852 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45683
I20260923 19:44:53.609478 27852 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:53.610335 27852 heartbeater.cc:511] Master 127.13.88.254:45683 requested a full tablet report, sending...
I20260923 19:44:53.612015 27529 ts_manager.cc:194] Registered new tserver with Master: a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
I20260923 19:44:53.613242 27529 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:33603
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:44:53.647805 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45683
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:53.968014 27857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:53.968284 27857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:53.968375 27857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:53.975402 27857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:53.975505 27857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:53.975616 27857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:44:53.984767 27857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:53.985991 27857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:53.987393 27857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:54.000311 27862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:54.000270 27863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:54.000349 27865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:54.001439 27857 server_base.cc:1034] running on GCE node
I20260923 19:44:54.002149 27857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:54.003268 27857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:54.004460 27857 hybrid_clock.cc:648] HybridClock initialized: now 1790192694004398 us; error 53 us; skew 500 ppm
I20260923 19:44:54.004772 27857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:54 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192694, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:54.008016 27857 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:44:54.009552 27857 webserver.cc:460] Webserver started at http://127.13.88.195:33389/ using document root <none> and password file <none>
I20260923 19:44:54.010241 27857 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:54.010373 27857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:54.010692 27857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:44:54.013693 27857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "bce1b165be434d8eaf89b793afc240b4"
format_stamp: "Formatted at 2026-09-23 19:44:54 on dist-test-slave-xg7f"
server_key: "e9fb47db068dd6beec31020d415a9873"
server_key_iv: "44845cbc00aa3282987585a58a4b6e0b"
server_key_version: "encryptionkey@0"
I20260923 19:44:54.014515 27857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "bce1b165be434d8eaf89b793afc240b4"
format_stamp: "Formatted at 2026-09-23 19:44:54 on dist-test-slave-xg7f"
server_key: "e9fb47db068dd6beec31020d415a9873"
server_key_iv: "44845cbc00aa3282987585a58a4b6e0b"
server_key_version: "encryptionkey@0"
I20260923 19:44:54.019735 27857 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260923 19:44:54.023082 27872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:54.024434 27857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:44:54.024602 27857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "bce1b165be434d8eaf89b793afc240b4"
format_stamp: "Formatted at 2026-09-23 19:44:54 on dist-test-slave-xg7f"
server_key: "e9fb47db068dd6beec31020d415a9873"
server_key_iv: "44845cbc00aa3282987585a58a4b6e0b"
server_key_version: "encryptionkey@0"
I20260923 19:44:54.024793 27857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:54.050518 27857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:54.054352 27857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:54.054656 27857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:54.055687 27857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:54.056979 27857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:54.057046 27857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:54.057186 27857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:54.057240 27857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:54.090708 27857 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:40623
I20260923 19:44:54.090727 27984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:40623 every 8 connection(s)
I20260923 19:44:54.092360 27857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:44:54.100131 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 27857
I20260923 19:44:54.100327 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:44:54.100915 13667 external_mini_cluster.cc:1428] Setting key c3d16df12ca7fc94c61b28276b70b259
Sep 23 19:44:54 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192694, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:54.112557 27720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.095042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:43347 (local address 127.13.88.254:45683)
0923 19:44:54.095269 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.095275 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.096410 (+ 1135us) server_negotiation.cc:407] Connection header received
0923 19:44:54.098187 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.098193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.098284 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.098413 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:54.099951 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.100866 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.102638 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.103225 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.103354 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.106659 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:54.106665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:54.106670 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:54.106712 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:54.109524 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.110222 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.110227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.110230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.110365 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.110778 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.110784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.110787 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.111050 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:54.111308 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.111980 (+ 672us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.112194 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260923 19:44:54.113487 27987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.095573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:43347)
0923 19:44:54.096246 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:54.096281 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:54.097919 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:54.098652 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:54.098660 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:54.099237 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:54.099781 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.099798 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.101019 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.101023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.102504 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.102516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.103442 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.103451 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.103684 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.104321 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:54.104342 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:54.106449 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:54.109660 (+ 3211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:54.109669 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:54.109685 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:54.110094 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:54.110485 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:54.110490 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:54.110494 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:54.110670 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:54.111284 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:54.111292 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:54.111614 (+ 322us) client_negotiation.cc:769] Sending connection context
0923 19:44:54.111887 (+ 273us) client_negotiation.cc:240] Negotiation successful
0923 19:44:54.112415 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":258,"threads_started":1}
I20260923 19:44:54.114933 27985 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45683
I20260923 19:44:54.115388 27985 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:54.116348 27985 heartbeater.cc:511] Master 127.13.88.254:45683 requested a full tablet report, sending...
I20260923 19:44:54.117707 27529 ts_manager.cc:194] Registered new tserver with Master: bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623)
I20260923 19:44:54.118480 27529 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:43347
I20260923 19:44:54.124331 27718 heartbeater.cc:503] Master 127.13.88.254:45683 was elected leader, sending a full tablet report...
I20260923 19:44:54.128612 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:44:54.144876 27720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.133082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53168 (local address 127.13.88.254:45683)
0923 19:44:54.133335 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.133344 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.133685 (+ 341us) server_negotiation.cc:407] Connection header received
0923 19:44:54.133815 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.133819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.133881 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.133957 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:54.135402 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.136099 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.137345 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.137740 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.137826 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.140207 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:54.140212 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:54.140215 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:54.140245 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:54.142592 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.143234 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.143237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.143239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.143367 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.143672 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.143675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.143677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.143952 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:54.144130 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.144395 (+ 265us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.144546 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:44:54.149044 27529 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:44:54.155932 27529 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:44:54.196134 28000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.168801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37516 (local address 127.13.88.194:44089)
0923 19:44:54.187087 (+ 18286us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.187115 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.188771 (+ 1656us) server_negotiation.cc:407] Connection header received
0923 19:44:54.188877 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.188885 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.189134 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.189356 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:54.190074 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.191567 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.193680 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.194991 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.195158 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.195372 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.195656 (+ 284us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.195821 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18049,"thread_start_us":18320,"threads_started":1}
I20260923 19:44:54.196169 27997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.168327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:44089 (local address 127.0.0.1:37516)
0923 19:44:54.188590 (+ 20263us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:54.188607 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:54.188725 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:54.189365 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:54.189370 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:54.189396 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:54.189875 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.189888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.191707 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.191719 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.193523 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.193538 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.195208 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.195214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.195414 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.195461 (+ 47us) client_negotiation.cc:769] Sending connection context
0923 19:44:54.195607 (+ 146us) client_negotiation.cc:240] Negotiation successful
0923 19:44:54.195792 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20138,"mutex_wait_us":130,"thread_start_us":14334,"threads_started":1}
I20260923 19:44:54.197677 28001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.167913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:40623 (local address 127.0.0.1:58330)
0923 19:44:54.187806 (+ 19893us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:54.187825 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:54.187967 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:54.188896 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:54.188904 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:54.188943 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:54.189495 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.189512 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.191528 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.191534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.194170 (+ 2636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.194185 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.196678 (+ 2493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.196685 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.196861 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.196940 (+ 79us) client_negotiation.cc:769] Sending connection context
0923 19:44:54.197030 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 19:44:54.197149 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19761,"mutex_wait_us":225,"spinlock_wait_cycles":2304,"thread_start_us":20384,"threads_started":1}
I20260923 19:44:54.198622 27998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.167876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:49944)
0923 19:44:54.183182 (+ 15306us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:54.183237 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:54.183477 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:54.188910 (+ 5433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:54.188913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:54.188950 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:54.189390 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.189402 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.191440 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.191448 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.194182 (+ 2734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.194191 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.196733 (+ 2542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.196738 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.196940 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.196967 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 19:44:54.198252 (+ 1285us) client_negotiation.cc:240] Negotiation successful
0923 19:44:54.198364 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14938,"mutex_wait_us":96,"spinlock_wait_cycles":1792,"thread_start_us":20030,"threads_started":1}
I20260923 19:44:54.199316 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.168970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49944 (local address 127.13.88.193:38579)
0923 19:44:54.187970 (+ 19000us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.187979 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.188012 (+ 33us) server_negotiation.cc:407] Connection header received
0923 19:44:54.188120 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.188130 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.188413 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.188606 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:54.189626 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.191296 (+ 1670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.194361 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.195950 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.196081 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.196598 (+ 517us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.198893 (+ 2295us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.199025 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18814,"thread_start_us":19514,"threads_started":1}
I20260923 19:44:54.200486 27787 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8f33deb4af40ec8633086646cd4144 (DEFAULT_TABLE table=test-table [id=e7f98eba35084aea94100a174b228a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:54.201709 27787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8f33deb4af40ec8633086646cd4144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:54.202514 27653 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8f33deb4af40ec8633086646cd4144 (DEFAULT_TABLE table=test-table [id=e7f98eba35084aea94100a174b228a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:54.203681 27653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8f33deb4af40ec8633086646cd4144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:54.197669 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.168247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58330 (local address 127.13.88.195:40623)
0923 19:44:54.182441 (+ 14194us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.182455 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.188104 (+ 5649us) server_negotiation.cc:407] Connection header received
0923 19:44:54.188194 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.188200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.188400 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.188606 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:54.189740 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.191346 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.194377 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.196168 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.196280 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.196516 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.197151 (+ 635us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.197317 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13945,"thread_start_us":13732,"threads_started":1}
I20260923 19:44:54.209970 27920 tablet_service.cc:1467] Processing CreateTablet for tablet 5e8f33deb4af40ec8633086646cd4144 (DEFAULT_TABLE table=test-table [id=e7f98eba35084aea94100a174b228a57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:54.211401 27920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e8f33deb4af40ec8633086646cd4144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:54.214443 28003 tablet_bootstrap.cc:492] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Bootstrap starting.
I20260923 19:44:54.217898 28003 tablet_bootstrap.cc:654] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:54.218926 28003 log.cc:824] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:54.219962 28004 tablet_bootstrap.cc:492] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Bootstrap starting.
I20260923 19:44:54.223413 28003 tablet_bootstrap.cc:492] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: No bootstrap required, opened a new log
I20260923 19:44:54.223696 28003 ts_tablet_manager.cc:1397] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260923 19:44:54.223902 28004 tablet_bootstrap.cc:654] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:54.225186 28004 log.cc:824] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:54.226145 28006 tablet_bootstrap.cc:492] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Bootstrap starting.
I20260923 19:44:54.229380 28004 tablet_bootstrap.cc:492] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: No bootstrap required, opened a new log
I20260923 19:44:54.229523 28006 tablet_bootstrap.cc:654] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:54.229667 28004 ts_tablet_manager.cc:1397] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260923 19:44:54.230859 28006 log.cc:824] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:54.233572 28006 tablet_bootstrap.cc:492] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: No bootstrap required, opened a new log
I20260923 19:44:54.233851 28006 ts_tablet_manager.cc:1397] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:44:54.235248 28003 raft_consensus.cc:348] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.235666 28003 raft_consensus.cc:374] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:54.235795 28003 raft_consensus.cc:729] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14c99314df9424696ff984ff441a892, State: Initialized, Role: FOLLOWER
I20260923 19:44:54.236418 28003 consensus_queue.cc:260] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.238057 28003 ts_tablet_manager.cc:1428] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260923 19:44:54.240106 28004 raft_consensus.cc:348] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.240548 28004 raft_consensus.cc:374] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:54.240643 28004 raft_consensus.cc:729] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a905164abbd1474fa36a4af0fdaff117, State: Initialized, Role: FOLLOWER
I20260923 19:44:54.241195 28004 consensus_queue.cc:260] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.242276 27852 heartbeater.cc:503] Master 127.13.88.254:45683 was elected leader, sending a full tablet report...
I20260923 19:44:54.242832 28004 ts_tablet_manager.cc:1428] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260923 19:44:54.243984 28006 raft_consensus.cc:348] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.244261 28006 raft_consensus.cc:374] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:54.244380 28006 raft_consensus.cc:729] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bce1b165be434d8eaf89b793afc240b4, State: Initialized, Role: FOLLOWER
I20260923 19:44:54.244937 28006 consensus_queue.cc:260] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.245970 27985 heartbeater.cc:503] Master 127.13.88.254:45683 was elected leader, sending a full tablet report...
I20260923 19:44:54.246881 28006 ts_tablet_manager.cc:1428] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Time spent starting tablet: real 0.013s user 0.004s sys 0.008s
W20260923 19:44:54.338956 27853 tablet.cc:2369] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:44:54.343385 27719 tablet.cc:2369] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:44:54.344055 27986 tablet.cc:2369] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:44:54.445107 28010 raft_consensus.cc:482] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:44:54.445444 28010 raft_consensus.cc:504] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.447366 28010 leader_election.cc:288] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), e14c99314df9424696ff984ff441a892 (127.13.88.193:38579)
I20260923 19:44:54.454144 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.448332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:34523 (local address 127.13.88.193:38579)
0923 19:44:54.448588 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.448596 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.448901 (+ 305us) server_negotiation.cc:407] Connection header received
0923 19:44:54.449092 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.449096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.449175 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.449275 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:54.449885 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.450622 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.452450 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.453214 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.453407 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.453480 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.453758 (+ 278us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.453890 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:44:54.454166 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.447730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:42145 (local address 127.13.88.195:40623)
0923 19:44:54.447978 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.447987 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.448670 (+ 683us) server_negotiation.cc:407] Connection header received
0923 19:44:54.448895 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.448902 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.448982 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.449080 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:54.449704 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.450492 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.452430 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.453176 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.453291 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.453408 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.453805 (+ 397us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.453923 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:44:54.454295 28013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.447844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.13.88.194:34523)
0923 19:44:54.448769 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:54.448807 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:54.448943 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:54.449308 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:54.449311 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:54.449333 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:54.449706 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.449716 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.450766 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.450769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.452274 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.452285 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.453461 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.453466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.453596 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.453635 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:44:54.453703 (+ 68us) client_negotiation.cc:240] Negotiation successful
0923 19:44:54.453837 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"mutex_wait_us":2,"thread_start_us":558,"threads_started":1}
I20260923 19:44:54.454349 28012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.447652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:40623 (local address 127.13.88.194:42145)
0923 19:44:54.448540 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:54.448569 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:54.448730 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:54.449100 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:54.449105 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:54.449129 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:54.449541 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.449551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.450632 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.450637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.452262 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:54.452274 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.453406 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.453412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:54.453584 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.453657 (+ 73us) client_negotiation.cc:769] Sending connection context
0923 19:44:54.453762 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:44:54.453880 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"mutex_wait_us":38,"thread_start_us":364,"threads_started":1}
I20260923 19:44:54.455511 27940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8f33deb4af40ec8633086646cd4144" candidate_uuid: "a905164abbd1474fa36a4af0fdaff117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce1b165be434d8eaf89b793afc240b4" is_pre_election: true
I20260923 19:44:54.455540 27673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8f33deb4af40ec8633086646cd4144" candidate_uuid: "a905164abbd1474fa36a4af0fdaff117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14c99314df9424696ff984ff441a892" is_pre_election: true
I20260923 19:44:54.455993 27673 raft_consensus.cc:2454] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a905164abbd1474fa36a4af0fdaff117 in term 0.
I20260923 19:44:54.456002 27940 raft_consensus.cc:2454] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a905164abbd1474fa36a4af0fdaff117 in term 0.
I20260923 19:44:54.456637 27740 leader_election.cc:302] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a905164abbd1474fa36a4af0fdaff117, bce1b165be434d8eaf89b793afc240b4, e14c99314df9424696ff984ff441a892; no voters:
I20260923 19:44:54.457015 28010 raft_consensus.cc:2781] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:44:54.457163 28010 raft_consensus.cc:482] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:44:54.457288 28010 raft_consensus.cc:3037] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:54.459596 28010 raft_consensus.cc:504] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.460227 28010 leader_election.cc:288] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [CANDIDATE]: Term 1 election: Requested vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), e14c99314df9424696ff984ff441a892 (127.13.88.193:38579)
I20260923 19:44:54.460595 27940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8f33deb4af40ec8633086646cd4144" candidate_uuid: "a905164abbd1474fa36a4af0fdaff117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce1b165be434d8eaf89b793afc240b4"
I20260923 19:44:54.460784 27940 raft_consensus.cc:3037] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:54.460806 27673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e8f33deb4af40ec8633086646cd4144" candidate_uuid: "a905164abbd1474fa36a4af0fdaff117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14c99314df9424696ff984ff441a892"
I20260923 19:44:54.460985 27673 raft_consensus.cc:3037] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:54.463896 27673 raft_consensus.cc:2454] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a905164abbd1474fa36a4af0fdaff117 in term 1.
I20260923 19:44:54.463893 27940 raft_consensus.cc:2454] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a905164abbd1474fa36a4af0fdaff117 in term 1.
I20260923 19:44:54.464260 27741 leader_election.cc:302] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a905164abbd1474fa36a4af0fdaff117, e14c99314df9424696ff984ff441a892; no voters:
I20260923 19:44:54.464552 28010 raft_consensus.cc:2781] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:44:54.464989 28010 raft_consensus.cc:686] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 1 LEADER]: Becoming Leader. State: Replica: a905164abbd1474fa36a4af0fdaff117, State: Running, Role: LEADER
I20260923 19:44:54.465579 28010 consensus_queue.cc:237] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } }
I20260923 19:44:54.470594 27528 catalog_manager.cc:5495] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 reported cstate change: term changed from 0 to 1, leader changed from <none> to a905164abbd1474fa36a4af0fdaff117 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "a905164abbd1474fa36a4af0fdaff117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } health_report { overall_health: HEALTHY } } }
I20260923 19:44:54.543869 28000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.538582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37522 (local address 127.13.88.194:44089)
0923 19:44:54.538794 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.538799 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.538819 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:44:54.538969 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.538973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.539047 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.539211 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:44:54.539655 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.540372 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.541708 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.542106 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.542235 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.542730 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:44:54.543247 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:44:54.543407 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.543511 (+ 104us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.543587 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:44:54.552030 27673 raft_consensus.cc:1261] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Refusing update from remote peer a905164abbd1474fa36a4af0fdaff117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:54.552028 27940 raft_consensus.cc:1261] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Refusing update from remote peer a905164abbd1474fa36a4af0fdaff117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:54.552980 28014 consensus_queue.cc:1035] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:54.553347 28010 consensus_queue.cc:1035] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:54.564677 28017 mvcc.cc:205] Tried to move back new op lower bound from 7332629276874797056 to 7332629276535037952. Current Snapshot: MvccSnapshot[applied={T|T < 7332629276874797056}]
I20260923 19:44:54.580295 27528 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:44:54.580572 27528 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:44:54.584043 27528 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Sending DeleteTablet for 3 replicas of tablet 5e8f33deb4af40ec8633086646cd4144
I20260923 19:44:54.585274 27920 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e8f33deb4af40ec8633086646cd4144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:54 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:58330
I20260923 19:44:54.585274 27653 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e8f33deb4af40ec8633086646cd4144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:54 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:49944
I20260923 19:44:54.589789 27787 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e8f33deb4af40ec8633086646cd4144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:54 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:37516
I20260923 19:44:54.591401 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27590
I20260923 19:44:54.599735 28029 tablet_replica.cc:330] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: stopping tablet replica
I20260923 19:44:54.600268 28029 raft_consensus.cc:2229] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:44:54.603717 28028 tablet_replica.cc:330] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: stopping tablet replica
I20260923 19:44:54.604244 28028 raft_consensus.cc:2229] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:44:54.604888 28028 raft_consensus.cc:2258] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:54.605321 28027 tablet_replica.cc:330] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: stopping tablet replica
I20260923 19:44:54.605834 28027 raft_consensus.cc:2229] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:44:54.606405 28027 raft_consensus.cc:2258] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:54.601071 28029 raft_consensus.cc:2258] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:54.608937 28027 ts_tablet_manager.cc:1905] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:54.608942 28029 ts_tablet_manager.cc:1905] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:54.612998 28028 ts_tablet_manager.cc:1905] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:54.616117 28029 ts_tablet_manager.cc:1918] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Sep 23 19:44:54 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:44:54.619988 28028 ts_tablet_manager.cc:1918] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:44:54.620257 28028 log.cc:1196] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/5e8f33deb4af40ec8633086646cd4144
I20260923 19:44:54.620834 28028 ts_tablet_manager.cc:1939] T 5e8f33deb4af40ec8633086646cd4144 P bce1b165be434d8eaf89b793afc240b4: Deleting consensus metadata
I20260923 19:44:54.621498 28029 log.cc:1196] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/5e8f33deb4af40ec8633086646cd4144
I20260923 19:44:54.623039 27513 catalog_manager.cc:4841] TS bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623): tablet 5e8f33deb4af40ec8633086646cd4144 (table test-table [id=e7f98eba35084aea94100a174b228a57]) successfully deleted
I20260923 19:44:54.624955 28027 ts_tablet_manager.cc:1918] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:44:54.625176 28027 log.cc:1196] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/5e8f33deb4af40ec8633086646cd4144
I20260923 19:44:54.625260 28029 ts_tablet_manager.cc:1939] T 5e8f33deb4af40ec8633086646cd4144 P a905164abbd1474fa36a4af0fdaff117: Deleting consensus metadata
I20260923 19:44:54.625795 28027 ts_tablet_manager.cc:1939] T 5e8f33deb4af40ec8633086646cd4144 P e14c99314df9424696ff984ff441a892: Deleting consensus metadata
I20260923 19:44:54.627220 27515 catalog_manager.cc:4841] TS a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089): tablet 5e8f33deb4af40ec8633086646cd4144 (table test-table [id=e7f98eba35084aea94100a174b228a57]) successfully deleted
I20260923 19:44:54.628371 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.592774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49954 (local address 127.13.88.193:38579)
0923 19:44:54.593018 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.593038 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.607493 (+ 14455us) server_negotiation.cc:407] Connection header received
0923 19:44:54.608111 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.608118 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.608209 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.608285 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:54.610421 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.611631 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.613672 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.614306 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.614400 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.620386 (+ 5986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:54.620404 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:54.620424 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:54.620475 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:54.624671 (+ 4196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.625639 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.625651 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.625658 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.625841 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.626320 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.626328 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.626334 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.626779 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:54.627130 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.627618 (+ 488us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.627846 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:44:54.628470 27514 catalog_manager.cc:4841] TS e14c99314df9424696ff984ff441a892 (127.13.88.193:38579): tablet 5e8f33deb4af40ec8633086646cd4144 (table test-table [id=e7f98eba35084aea94100a174b228a57]) successfully deleted
I20260923 19:44:54.629055 27713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:54.721701 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27590
I20260923 19:44:54.740262 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27724
Sep 23 19:44:54 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:44:54.757934 28000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.741022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.13.88.194:44089)
0923 19:44:54.741219 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.741223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.741350 (+ 127us) server_negotiation.cc:407] Connection header received
0923 19:44:54.741527 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.741530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.741609 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.741684 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:54.743366 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.744313 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.746251 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.746679 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.746769 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.751944 (+ 5175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:54.751958 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:54.751974 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:54.752011 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:54.755008 (+ 2997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.755824 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.755834 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.755837 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.755985 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.756356 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.756363 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.756368 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.756715 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:54.757092 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.757335 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.757551 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:44:54.758641 27847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:54.873202 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27724
I20260923 19:44:54.888187 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27857
Sep 23 19:44:54 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:44:54.903667 27999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:54.888962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58342 (local address 127.13.88.195:40623)
0923 19:44:54.889168 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:54.889177 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:54.889199 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:44:54.889472 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:54.889477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:54.889542 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:54.889665 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:54.891009 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.891826 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.893176 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:54.893584 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:54.893716 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:54.898260 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:54.898274 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:54.898291 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:54.898324 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:54.900856 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.901529 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.901537 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.901540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.901672 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:54.902126 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:54.902141 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:54.902143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:54.902474 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:54.902789 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:54.903120 (+ 331us) server_negotiation.cc:299] Negotiation successful
0923 19:44:54.903337 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:44:54.904297 27980 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:54.992163 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27857
I20260923 19:44:55.009030 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 27497
I20260923 19:44:55.010138 27559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:55.120009 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 27497
I20260923 19:44:55.141793 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45683
--webserver_interface=127.13.88.254
--webserver_port=37225
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:55.465729 28035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:55.466039 28035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:55.466213 28035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:55.473755 28035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:55.473870 28035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:55.473973 28035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:55.474077 28035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:55.474166 28035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:55.484781 28035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=37225
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:55.486157 28035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:55.487560 28035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:55.510303 28044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:55.510248 28042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:55.510325 28041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:55.516779 28035 server_base.cc:1034] running on GCE node
I20260923 19:44:55.517724 28035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:55.519482 28035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:55.520689 28035 hybrid_clock.cc:648] HybridClock initialized: now 1790192695520644 us; error 37 us; skew 500 ppm
I20260923 19:44:55.521136 28035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:55 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192695, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:55.524742 28035 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:44:55.526523 28035 webserver.cc:460] Webserver started at http://127.13.88.254:37225/ using document root <none> and password file <none>
I20260923 19:44:55.527418 28035 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:55.527586 28035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:55.533702 28035 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:44:55.536805 28051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:55.538239 28035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260923 19:44:55.538446 28035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "0dd9bc54757a481a86f0d006f08b1223"
format_stamp: "Formatted at 2026-09-23 19:44:52 on dist-test-slave-xg7f"
server_key: "3f097b7319a19da97f4359dd222f35e3"
server_key_iv: "2c63f494b0b12858f452df21d38b5a52"
server_key_version: "encryptionkey@0"
I20260923 19:44:55.539625 28035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:55.569563 28035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:55.574414 28035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:55.574709 28035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:55.594027 28035 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:45683
I20260923 19:44:55.594051 28102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:45683 every 8 connection(s)
I20260923 19:44:55.595599 28035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:44:55.603189 28103 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:44:55.605448 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28035
I20260923 19:44:55.606441 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:38579
--local_ip_for_outbound_sockets=127.13.88.193
--tserver_master_addrs=127.13.88.254:45683
--webserver_port=39371
--webserver_interface=127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:55.607406 28103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Bootstrap starting.
I20260923 19:44:55.629516 28103 log.cc:824] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:55.641992 28103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:44:55.642555 28103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Bootstrap complete.
I20260923 19:44:55.652136 28103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:55.653115 28103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dd9bc54757a481a86f0d006f08b1223, State: Initialized, Role: FOLLOWER
I20260923 19:44:55.653736 28103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:55.653997 28103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:44:55.654116 28103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:44:55.654327 28103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:44:55.658262 28103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:55.658826 28103 leader_election.cc:302] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0dd9bc54757a481a86f0d006f08b1223; no voters:
I20260923 19:44:55.659574 28103 leader_election.cc:288] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:44:55.659713 28107 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:44:55.660972 28107 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 LEADER]: Becoming Leader. State: Replica: 0dd9bc54757a481a86f0d006f08b1223, State: Running, Role: LEADER
I20260923 19:44:55.661567 28107 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:55.662127 28103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:55.674346 28109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0dd9bc54757a481a86f0d006f08b1223. Latest consensus state: current_term: 2 leader_uuid: "0dd9bc54757a481a86f0d006f08b1223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } } }
I20260923 19:44:55.674870 28109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:55.675781 28117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:44:55.675661 28108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0dd9bc54757a481a86f0d006f08b1223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } } }
I20260923 19:44:55.676092 28108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:55.685288 28117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:44:55.687177 28117 catalog_manager.cc:1259] Loaded cluster ID: 87436a2185074f2bbcadd21faf79e678
I20260923 19:44:55.687304 28117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:44:55.691416 28117 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260923 19:44:55.717483 28117 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260923 19:44:55.735940 28117 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:44:55.737793 28117 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Loaded TSK: 0
I20260923 19:44:55.739495 28117 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 19:44:55.970685 28105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:55.971009 28105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:55.971190 28105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:55.978492 28105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:55.978632 28105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:55.978777 28105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:44:55.988996 28105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:38579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=39371
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:55.990334 28105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:55.991782 28105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:56.006012 28131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:56.006047 28132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:56.007081 28134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:56.007596 28105 server_base.cc:1034] running on GCE node
I20260923 19:44:56.008235 28105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:56.009214 28105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:56.010448 28105 hybrid_clock.cc:648] HybridClock initialized: now 1790192696010395 us; error 57 us; skew 500 ppm
I20260923 19:44:56.010772 28105 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:56 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192696, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:56.014106 28105 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:44:56.015746 28105 webserver.cc:460] Webserver started at http://127.13.88.193:39371/ using document root <none> and password file <none>
I20260923 19:44:56.016463 28105 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:56.016608 28105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:56.022116 28105 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:44:56.025197 28141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.026661 28105 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:44:56.026858 28105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "e14c99314df9424696ff984ff441a892"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "f6968d9e63d90c7cc98d071e14aa31f5"
server_key_iv: "6d5f4d8c1c014f1dbd5fdfe12932515a"
server_key_version: "encryptionkey@0"
I20260923 19:44:56.027971 28105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:56.045776 28105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:56.050235 28105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:56.050529 28105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:56.051658 28105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:56.053081 28105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:56.053210 28105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.053383 28105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:56.053470 28105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.086793 28105 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:38579
I20260923 19:44:56.086858 28253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:38579 every 8 connection(s)
I20260923 19:44:56.088311 28105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:44:56.095033 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28105
I20260923 19:44:56.095873 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:44089
--local_ip_for_outbound_sockets=127.13.88.194
--tserver_master_addrs=127.13.88.254:45683
--webserver_port=41679
--webserver_interface=127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:44:56 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192696, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:56.112931 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:56.091175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:57479 (local address 127.13.88.254:45683)
0923 19:44:56.091807 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:56.091818 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:56.092344 (+ 526us) server_negotiation.cc:407] Connection header received
0923 19:44:56.094427 (+ 2083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:56.094445 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:56.094935 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:56.095429 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:56.096884 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.098931 (+ 2047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.100548 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.101640 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.101835 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:56.105553 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:56.105561 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:56.105576 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:56.105616 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:56.108424 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:56.109174 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:56.109181 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:56.109187 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:56.109339 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:56.109810 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:56.109814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:56.109816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:56.110259 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:56.110481 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:56.111292 (+ 811us) server_negotiation.cc:299] Negotiation successful
0923 19:44:56.111678 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":279,"threads_started":1}
I20260923 19:44:56.112915 28257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:56.091347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:57479)
0923 19:44:56.092160 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:56.092219 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:56.093921 (+ 1702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:56.095517 (+ 1596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:56.095525 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:56.096073 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:56.096638 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:56.096656 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.099145 (+ 2489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.099153 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:56.100401 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:56.100413 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.101952 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.101958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:56.102169 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:56.102883 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:56.102907 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:56.105288 (+ 2381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:56.108573 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:56.108584 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:56.108600 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:56.109022 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:56.109473 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:56.109479 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:56.109482 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:56.109683 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:56.110409 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:56.110417 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:56.110759 (+ 342us) client_negotiation.cc:769] Sending connection context
0923 19:44:56.111016 (+ 257us) client_negotiation.cc:240] Negotiation successful
0923 19:44:56.111607 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":341,"threads_started":1}
I20260923 19:44:56.115921 28254 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45683
I20260923 19:44:56.116235 28254 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:56.116974 28254 heartbeater.cc:511] Master 127.13.88.254:45683 requested a full tablet report, sending...
I20260923 19:44:56.119216 28068 ts_manager.cc:194] Registered new tserver with Master: e14c99314df9424696ff984ff441a892 (127.13.88.193:38579)
I20260923 19:44:56.120748 28068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:57479
W20260923 19:44:56.428004 28258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:56.428328 28258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:56.428505 28258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:56.435850 28258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:56.436003 28258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:56.436195 28258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:44:56.445815 28258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:44089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=41679
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:56.447082 28258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:56.448413 28258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:56.461174 28263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:56.461252 28266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:56.461243 28264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:56.462179 28258 server_base.cc:1034] running on GCE node
I20260923 19:44:56.462836 28258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:56.463882 28258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:56.465119 28258 hybrid_clock.cc:648] HybridClock initialized: now 1790192696465077 us; error 35 us; skew 500 ppm
I20260923 19:44:56.465492 28258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:56 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192696, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:56.468786 28258 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:44:56.470137 28258 webserver.cc:460] Webserver started at http://127.13.88.194:41679/ using document root <none> and password file <none>
I20260923 19:44:56.470798 28258 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:56.470909 28258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:56.476469 28258 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:44:56.479285 28273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.480612 28258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:44:56.480752 28258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "a905164abbd1474fa36a4af0fdaff117"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "522fd4f69c3cd17bebf4d8e30ffcde40"
server_key_iv: "56e005ba713cc95cfbecbc813af1e4c2"
server_key_version: "encryptionkey@0"
I20260923 19:44:56.481668 28258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:56.502789 28258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:56.506881 28258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:56.507159 28258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:56.508122 28258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:56.509404 28258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:56.509498 28258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.509585 28258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:56.509641 28258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.541291 28258 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:44089
I20260923 19:44:56.541352 28385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:44089 every 8 connection(s)
I20260923 19:44:56.542754 28258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:44:56.549901 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28258
I20260923 19:44:56.550663 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:40623
--local_ip_for_outbound_sockets=127.13.88.195
--tserver_master_addrs=127.13.88.254:45683
--webserver_port=33389
--webserver_interface=127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:44:56 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192696, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:56.563092 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:56.545391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:34445 (local address 127.13.88.254:45683)
0923 19:44:56.545567 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:56.545570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:56.546646 (+ 1076us) server_negotiation.cc:407] Connection header received
0923 19:44:56.548490 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:56.548496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:56.548588 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:56.548696 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:56.550156 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.551324 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.552821 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.553541 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.553691 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:56.557433 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:56.557438 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:56.557442 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:56.557473 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:56.559985 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:56.560862 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:56.560866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:56.560869 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:56.560984 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:56.561480 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:56.561483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:56.561485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:56.561724 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:56.561828 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:56.562684 (+ 856us) server_negotiation.cc:299] Negotiation successful
0923 19:44:56.562854 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:44:56.564677 28388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:56.545794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:34445)
0923 19:44:56.546464 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:56.546526 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:56.548198 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:56.548941 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:56.548949 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:56.549420 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:56.549962 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:56.549979 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.551480 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.551484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:56.552673 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:56.552685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.553762 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.553768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:56.553953 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:56.554772 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:56.554817 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:56.557191 (+ 2374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:56.560111 (+ 2920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:56.560123 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:56.560141 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:56.560747 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:56.561093 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:56.561101 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:56.561107 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:56.561357 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:56.561852 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:56.561863 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:56.562300 (+ 437us) client_negotiation.cc:769] Sending connection context
0923 19:44:56.562603 (+ 303us) client_negotiation.cc:240] Negotiation successful
0923 19:44:56.563171 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":249,"threads_started":1}
I20260923 19:44:56.566170 28386 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45683
I20260923 19:44:56.566468 28386 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:56.567276 28386 heartbeater.cc:511] Master 127.13.88.254:45683 requested a full tablet report, sending...
I20260923 19:44:56.568732 28068 ts_manager.cc:194] Registered new tserver with Master: a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
I20260923 19:44:56.569564 28068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:34445
W20260923 19:44:56.877027 28389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:56.877413 28389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:56.877575 28389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:56.885020 28389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:56.885178 28389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:56.885352 28389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:44:56.894963 28389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:40623
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=33389
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:56.896270 28389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:56.897536 28389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:56.910522 28395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:56.910454 28394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:56.910487 28397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:56.911432 28389 server_base.cc:1034] running on GCE node
I20260923 19:44:56.912073 28389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:56.913064 28389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:56.914299 28389 hybrid_clock.cc:648] HybridClock initialized: now 1790192696914248 us; error 43 us; skew 500 ppm
I20260923 19:44:56.914645 28389 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:56 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192696, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:56.917815 28389 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:44:56.919346 28389 webserver.cc:460] Webserver started at http://127.13.88.195:33389/ using document root <none> and password file <none>
I20260923 19:44:56.920068 28389 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:56.920230 28389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:56.925585 28389 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.003s
I20260923 19:44:56.928287 28404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.929562 28389 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:44:56.929770 28389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "bce1b165be434d8eaf89b793afc240b4"
format_stamp: "Formatted at 2026-09-23 19:44:54 on dist-test-slave-xg7f"
server_key: "e9fb47db068dd6beec31020d415a9873"
server_key_iv: "44845cbc00aa3282987585a58a4b6e0b"
server_key_version: "encryptionkey@0"
I20260923 19:44:56.930732 28389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:56.948200 28389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:56.952026 28389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:56.952294 28389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:56.953244 28389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:56.954630 28389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:56.954762 28389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.954902 28389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:56.954988 28389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:56.987435 28389 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:40623
I20260923 19:44:56.987515 28516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:40623 every 8 connection(s)
I20260923 19:44:56.988804 28389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:44:56.996508 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28389
Sep 23 19:44:56 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192696, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:44:57.008870 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:56.991242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:49867 (local address 127.13.88.254:45683)
0923 19:44:56.991434 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:56.991439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:56.992534 (+ 1095us) server_negotiation.cc:407] Connection header received
0923 19:44:56.994242 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:56.994247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:56.994332 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:56.994449 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:56.995898 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.996749 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.998715 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.999155 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.999271 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.002782 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:57.002787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:57.002790 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:57.002821 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:57.005710 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.006439 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.006444 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.006448 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.006575 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.007007 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.007012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.007015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.007370 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:57.007530 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.008233 (+ 703us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.008543 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:44:57.009850 28519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:56.991702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:49867)
0923 19:44:56.992379 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:56.992420 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:56.993986 (+ 1566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:56.994672 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:56.994680 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:56.995192 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:44:56.995730 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:56.995746 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.996916 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.996920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:56.998541 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:56.998557 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:56.999408 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:56.999417 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:56.999739 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.000460 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:44:57.000480 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:44:57.002575 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:44:57.005853 (+ 3278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:57.005864 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:57.005880 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:57.006301 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:57.006695 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:44:57.006700 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:44:57.006704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:44:57.006886 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:44:57.007503 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:44:57.007511 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:44:57.007859 (+ 348us) client_negotiation.cc:769] Sending connection context
0923 19:44:57.008130 (+ 271us) client_negotiation.cc:240] Negotiation successful
0923 19:44:57.008691 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":278,"threads_started":1}
I20260923 19:44:57.011397 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:56.997396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53184 (local address 127.13.88.254:45683)
0923 19:44:56.998220 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:56.998225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:56.998240 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:44:56.998277 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:56.998280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:56.998337 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:56.998421 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:57.000356 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.001243 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.002756 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.003310 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.003465 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.005921 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:57.005926 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:57.005930 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:57.005956 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:57.008559 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.009340 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.009355 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.009358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.009481 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.009841 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.009846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.009850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.010165 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:57.010439 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.010723 (+ 284us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.010967 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":608,"threads_started":1}
I20260923 19:44:57.011381 28517 heartbeater.cc:347] Connected to a master server at 127.13.88.254:45683
I20260923 19:44:57.011727 28517 heartbeater.cc:464] Registering TS with master...
I20260923 19:44:57.012663 28517 heartbeater.cc:511] Master 127.13.88.254:45683 requested a full tablet report, sending...
I20260923 19:44:57.014221 28068 ts_manager.cc:194] Registered new tserver with Master: bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623)
I20260923 19:44:57.015031 28068 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:49867
I20260923 19:44:57.026021 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:44:57.032964 28520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.026837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53196 (local address 127.13.88.254:45683)
0923 19:44:57.027023 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.027028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.027528 (+ 500us) server_negotiation.cc:407] Connection header received
0923 19:44:57.027724 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.027727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.027869 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.027991 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:44:57.028351 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.029065 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.030517 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.030938 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.031030 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.031656 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:44:57.032233 (+ 577us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:44:57.032433 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.032563 (+ 130us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.032650 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:44:57.033946 28068 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:53196:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:44:57.041291 28068 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:44:57.066433 28528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.052830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:40623 (local address 127.0.0.1:58344)
0923 19:44:57.054558 (+ 1728us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.054608 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:57.054820 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:57.056907 (+ 2087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:57.056917 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:57.056949 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:57.057457 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.057477 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.060680 (+ 3203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.060687 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.063393 (+ 2706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.063408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.065309 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.065318 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.065616 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.065696 (+ 80us) client_negotiation.cc:769] Sending connection context
0923 19:44:57.065848 (+ 152us) client_negotiation.cc:240] Negotiation successful
0923 19:44:57.066023 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1363,"mutex_wait_us":53,"thread_start_us":8646,"threads_started":1}
I20260923 19:44:57.066604 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.053765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37532 (local address 127.13.88.194:44089)
0923 19:44:57.056248 (+ 2483us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.056255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.057595 (+ 1340us) server_negotiation.cc:407] Connection header received
0923 19:44:57.057882 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.057892 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.058128 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.058280 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:57.059176 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.060646 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.063768 (+ 3122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.065191 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.065275 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.065487 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.066132 (+ 645us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.066289 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2325,"thread_start_us":3104,"threads_started":1}
I20260923 19:44:57.066669 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.053111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.13.88.195:40623)
0923 19:44:57.055523 (+ 2412us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.055531 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.055562 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:44:57.055654 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.055661 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.056407 (+ 746us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.057675 (+ 1268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:57.057932 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.060519 (+ 2587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.063612 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.065066 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.065200 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.065456 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.066150 (+ 694us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.066303 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2262,"thread_start_us":2103,"threads_started":1}
I20260923 19:44:57.067431 28531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.052988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:44089 (local address 127.0.0.1:37532)
0923 19:44:57.057485 (+ 4497us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.057503 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:57.057688 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:57.058604 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:57.058609 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:57.058632 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:57.058964 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.058975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.060817 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.060822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.063610 (+ 2788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.063621 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.065701 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.065709 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.065932 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.065964 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:44:57.066822 (+ 858us) client_negotiation.cc:240] Negotiation successful
0923 19:44:57.066966 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4363,"mutex_wait_us":647,"thread_start_us":1033,"threads_started":1}
I20260923 19:44:57.070856 28321 tablet_service.cc:1467] Processing CreateTablet for tablet 4501197b6d7a4cd48b8c0c8ad887034f (DEFAULT_TABLE table=test-table [id=c869a674bae3490ba4e065149d3f4d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:57.070621 28452 tablet_service.cc:1467] Processing CreateTablet for tablet 4501197b6d7a4cd48b8c0c8ad887034f (DEFAULT_TABLE table=test-table [id=c869a674bae3490ba4e065149d3f4d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:57.072214 28452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4501197b6d7a4cd48b8c0c8ad887034f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:57.072214 28321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4501197b6d7a4cd48b8c0c8ad887034f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:57.073012 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.056345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:49962)
0923 19:44:57.061729 (+ 5384us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.061745 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:57.061841 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:57.067226 (+ 5385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:57.067230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:57.067255 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:57.067648 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.067663 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.069421 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.069425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.070691 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.070715 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.072175 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.072181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.072443 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.072465 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:44:57.072568 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 19:44:57.072691 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5257,"thread_start_us":866,"threads_started":1}
I20260923 19:44:57.073130 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.056995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49962 (local address 127.13.88.193:38579)
0923 19:44:57.066132 (+ 9137us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.066141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.066165 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:44:57.066259 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.066266 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.066995 (+ 729us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.067216 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:57.067851 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.069288 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.070881 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.071953 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.072109 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.072303 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.072627 (+ 324us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.072776 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8973,"thread_start_us":8860,"threads_started":1}
I20260923 19:44:57.076284 28189 tablet_service.cc:1467] Processing CreateTablet for tablet 4501197b6d7a4cd48b8c0c8ad887034f (DEFAULT_TABLE table=test-table [id=c869a674bae3490ba4e065149d3f4d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:44:57.077425 28189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4501197b6d7a4cd48b8c0c8ad887034f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:44:57.093683 28533 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Bootstrap starting.
I20260923 19:44:57.097978 28534 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Bootstrap starting.
I20260923 19:44:57.101609 28533 tablet_bootstrap.cc:654] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:57.101611 28534 tablet_bootstrap.cc:654] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:57.102873 28534 log.cc:824] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:57.102866 28533 log.cc:824] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:57.105209 28535 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Bootstrap starting.
I20260923 19:44:57.106511 28533 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: No bootstrap required, opened a new log
I20260923 19:44:57.106781 28533 ts_tablet_manager.cc:1397] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260923 19:44:57.109542 28535 tablet_bootstrap.cc:654] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Neither blocks nor log segments found. Creating new log.
I20260923 19:44:57.110662 28535 log.cc:824] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:57.111974 28534 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: No bootstrap required, opened a new log
I20260923 19:44:57.112231 28534 ts_tablet_manager.cc:1397] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260923 19:44:57.113152 28535 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: No bootstrap required, opened a new log
I20260923 19:44:57.113397 28535 ts_tablet_manager.cc:1397] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260923 19:44:57.115696 28533 raft_consensus.cc:348] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.116102 28533 raft_consensus.cc:374] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:57.116209 28533 raft_consensus.cc:729] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bce1b165be434d8eaf89b793afc240b4, State: Initialized, Role: FOLLOWER
I20260923 19:44:57.116798 28533 consensus_queue.cc:260] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.117893 28517 heartbeater.cc:503] Master 127.13.88.254:45683 was elected leader, sending a full tablet report...
I20260923 19:44:57.118495 28533 ts_tablet_manager.cc:1428] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260923 19:44:57.122277 28534 raft_consensus.cc:348] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.122712 28534 raft_consensus.cc:374] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:57.122857 28534 raft_consensus.cc:729] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a905164abbd1474fa36a4af0fdaff117, State: Initialized, Role: FOLLOWER
I20260923 19:44:57.122812 28535 raft_consensus.cc:348] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.123262 28535 raft_consensus.cc:374] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:44:57.123377 28535 raft_consensus.cc:729] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14c99314df9424696ff984ff441a892, State: Initialized, Role: FOLLOWER
I20260923 19:44:57.123476 28534 consensus_queue.cc:260] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.123745 28254 heartbeater.cc:503] Master 127.13.88.254:45683 was elected leader, sending a full tablet report...
I20260923 19:44:57.123983 28535 consensus_queue.cc:260] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.124650 28386 heartbeater.cc:503] Master 127.13.88.254:45683 was elected leader, sending a full tablet report...
I20260923 19:44:57.125138 28534 ts_tablet_manager.cc:1428] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260923 19:44:57.127086 28535 ts_tablet_manager.cc:1428] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
W20260923 19:44:57.240515 28518 tablet.cc:2369] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:44:57.249106 28541 raft_consensus.cc:482] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:44:57.249439 28541 raft_consensus.cc:504] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.251170 28541 leader_election.cc:288] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
I20260923 19:44:57.257952 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.251579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:58325 (local address 127.13.88.195:40623)
0923 19:44:57.251798 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.251804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.252498 (+ 694us) server_negotiation.cc:407] Connection header received
0923 19:44:57.252698 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.252707 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.252790 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.252852 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:57.253471 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.254204 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.256139 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.256921 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.257093 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.257187 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.257511 (+ 324us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.257668 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:44:57.258222 28542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.251385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:40623 (local address 127.13.88.193:58325)
0923 19:44:57.252385 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.252400 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:57.252517 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:57.252902 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:57.252909 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:57.252936 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:57.253323 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.253332 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.254326 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.254332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.255999 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.256010 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.257128 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.257133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.257326 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.257358 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:44:57.257467 (+ 109us) client_negotiation.cc:240] Negotiation successful
0923 19:44:57.257621 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":844,"mutex_wait_us":18,"spinlock_wait_cycles":1408,"thread_start_us":604,"threads_started":1}
I20260923 19:44:57.258253 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.251734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:56517 (local address 127.13.88.194:44089)
0923 19:44:57.251950 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.251958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.252581 (+ 623us) server_negotiation.cc:407] Connection header received
0923 19:44:57.252765 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.252768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.252849 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.252937 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:44:57.253513 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.254204 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.256235 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.256964 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.257133 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.257220 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.257676 (+ 456us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.257814 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 19:44:57.258348 28543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.251544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:44089 (local address 127.13.88.193:56517)
0923 19:44:57.252437 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.252477 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:44:57.252625 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:44:57.252973 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:44:57.252978 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:44:57.253008 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:44:57.253349 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.253356 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.254331 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.254338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.256079 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:44:57.256094 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.257372 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.257377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:44:57.257509 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.257532 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:44:57.257651 (+ 119us) client_negotiation.cc:240] Negotiation successful
0923 19:44:57.257769 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"mutex_wait_us":18,"thread_start_us":508,"threads_started":1}
I20260923 19:44:57.259290 28341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4501197b6d7a4cd48b8c0c8ad887034f" candidate_uuid: "e14c99314df9424696ff984ff441a892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a905164abbd1474fa36a4af0fdaff117" is_pre_election: true
I20260923 19:44:57.259279 28472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4501197b6d7a4cd48b8c0c8ad887034f" candidate_uuid: "e14c99314df9424696ff984ff441a892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce1b165be434d8eaf89b793afc240b4" is_pre_election: true
I20260923 19:44:57.259756 28472 raft_consensus.cc:2454] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e14c99314df9424696ff984ff441a892 in term 0.
I20260923 19:44:57.259760 28341 raft_consensus.cc:2454] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e14c99314df9424696ff984ff441a892 in term 0.
I20260923 19:44:57.260383 28142 leader_election.cc:302] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce1b165be434d8eaf89b793afc240b4, e14c99314df9424696ff984ff441a892; no voters:
I20260923 19:44:57.260742 28541 raft_consensus.cc:2781] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:44:57.260895 28541 raft_consensus.cc:482] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:44:57.261009 28541 raft_consensus.cc:3037] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:57.263262 28541 raft_consensus.cc:504] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.263873 28541 leader_election.cc:288] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 1 election: Requested vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
I20260923 19:44:57.264266 28341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4501197b6d7a4cd48b8c0c8ad887034f" candidate_uuid: "e14c99314df9424696ff984ff441a892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a905164abbd1474fa36a4af0fdaff117"
I20260923 19:44:57.264266 28472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4501197b6d7a4cd48b8c0c8ad887034f" candidate_uuid: "e14c99314df9424696ff984ff441a892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bce1b165be434d8eaf89b793afc240b4"
I20260923 19:44:57.264462 28472 raft_consensus.cc:3037] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:57.264459 28341 raft_consensus.cc:3037] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:44:57.267511 28472 raft_consensus.cc:2454] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e14c99314df9424696ff984ff441a892 in term 1.
I20260923 19:44:57.267513 28341 raft_consensus.cc:2454] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e14c99314df9424696ff984ff441a892 in term 1.
I20260923 19:44:57.267911 28144 leader_election.cc:302] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a905164abbd1474fa36a4af0fdaff117, e14c99314df9424696ff984ff441a892; no voters:
I20260923 19:44:57.268240 28541 raft_consensus.cc:2781] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:44:57.268599 28541 raft_consensus.cc:686] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 LEADER]: Becoming Leader. State: Replica: e14c99314df9424696ff984ff441a892, State: Running, Role: LEADER
I20260923 19:44:57.269002 28541 consensus_queue.cc:237] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:57.273774 28068 catalog_manager.cc:5495] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 reported cstate change: term changed from 0 to 1, leader changed from <none> to e14c99314df9424696ff984ff441a892 (127.13.88.193). New cstate: current_term: 1 leader_uuid: "e14c99314df9424696ff984ff441a892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } health_report { overall_health: HEALTHY } } }
W20260923 19:44:57.294797 28387 tablet.cc:2369] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:44:57.299041 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.293640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49966 (local address 127.13.88.193:38579)
0923 19:44:57.293838 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.293845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.293948 (+ 103us) server_negotiation.cc:407] Connection header received
0923 19:44:57.294174 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.294178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.294249 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.294425 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:44:57.294812 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.295589 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.297043 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.297435 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.297567 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.298027 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:44:57.298478 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:44:57.298647 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.298691 (+ 44us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.298762 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:44:57.306672 28472 raft_consensus.cc:1261] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Refusing update from remote peer e14c99314df9424696ff984ff441a892: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:57.306674 28341 raft_consensus.cc:1261] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 1 FOLLOWER]: Refusing update from remote peer e14c99314df9424696ff984ff441a892: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:44:57.307771 28544 consensus_queue.cc:1035] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:57.308107 28541 consensus_queue.cc:1035] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:44:57.317426 28547 mvcc.cc:205] Tried to move back new op lower bound from 7332629288158527488 to 7332629288017272832. Current Snapshot: MvccSnapshot[applied={T|T < 7332629288158527488}]
I20260923 19:44:57.332463 28067 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:53196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:44:57.332728 28067 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:53196:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:44:57.336489 28067 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Sending DeleteTablet for 3 replicas of tablet 4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:44:57.337765 28452 tablet_service.cc:1514] Processing DeleteTablet for tablet 4501197b6d7a4cd48b8c0c8ad887034f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:57 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:58344
I20260923 19:44:57.337795 28189 tablet_service.cc:1514] Processing DeleteTablet for tablet 4501197b6d7a4cd48b8c0c8ad887034f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:57 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:49962
I20260923 19:44:57.338660 28557 tablet_replica.cc:330] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: stopping tablet replica
I20260923 19:44:57.338560 28321 tablet_service.cc:1514] Processing DeleteTablet for tablet 4501197b6d7a4cd48b8c0c8ad887034f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:44:57 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:37532
I20260923 19:44:57.339197 28557 raft_consensus.cc:2229] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:44:57.339720 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 28105
I20260923 19:44:57.339726 28557 raft_consensus.cc:2258] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:57.350203 28559 tablet_replica.cc:330] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: stopping tablet replica
I20260923 19:44:57.350777 28559 raft_consensus.cc:2229] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:44:57.351449 28559 raft_consensus.cc:2258] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:44:57.353057 28557 ts_tablet_manager.cc:1905] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:57.353901 28559 ts_tablet_manager.cc:1905] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:44:57.363569 28559 ts_tablet_manager.cc:1918] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:44:57.363758 28559 log.cc:1196] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:44:57.364431 28559 ts_tablet_manager.cc:1939] T 4501197b6d7a4cd48b8c0c8ad887034f P a905164abbd1474fa36a4af0fdaff117: Deleting consensus metadata
I20260923 19:44:57.364709 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.340584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49976 (local address 127.13.88.193:38579)
0923 19:44:57.342206 (+ 1622us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.342212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.342228 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:44:57.342305 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.342310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.342418 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.342513 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:57.344649 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.345885 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.348043 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.348741 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.348874 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.354409 (+ 5535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:57.354423 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:57.354439 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:57.354482 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:57.358719 (+ 4237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.359689 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.359697 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.359701 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.359880 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.362259 (+ 2379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.362264 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.362268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.362698 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:57.363133 (+ 435us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.364019 (+ 886us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.364241 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1505}
I20260923 19:44:57.366134 28249 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:57.366760 28054 catalog_manager.cc:4841] TS a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089): tablet 4501197b6d7a4cd48b8c0c8ad887034f (table test-table [id=c869a674bae3490ba4e065149d3f4d03]) successfully deleted
I20260923 19:44:57.372676 28557 ts_tablet_manager.cc:1918] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:44:57.372857 28557 log.cc:1196] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:44:57.373322 28557 ts_tablet_manager.cc:1939] T 4501197b6d7a4cd48b8c0c8ad887034f P bce1b165be434d8eaf89b793afc240b4: Deleting consensus metadata
I20260923 19:44:57.374850 28052 catalog_manager.cc:4841] TS bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623): tablet 4501197b6d7a4cd48b8c0c8ad887034f (table test-table [id=c869a674bae3490ba4e065149d3f4d03]) successfully deleted
I20260923 19:44:57.462175 28558 tablet_replica.cc:330] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: stopping tablet replica
I20260923 19:44:57.462471 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 28105
I20260923 19:44:57.480417 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 28258
W20260923 19:44:57.480417 28053 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.88.193:38579 (error 108)
I20260923 19:44:57.482168 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.481784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:49988)
0923 19:44:57.481953 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.482041 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260923 19:44:57.482368 28053 catalog_manager.cc:4584] TS e14c99314df9424696ff984ff441a892 (127.13.88.193:38579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4501197b6d7a4cd48b8c0c8ad887034f: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
I20260923 19:44:57.498932 28530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.481250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37536 (local address 127.13.88.194:44089)
0923 19:44:57.481473 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.481479 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.481500 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:44:57.481678 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.481689 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.481749 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.481877 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:57.483302 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.484054 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.485397 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.485815 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.485955 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.493724 (+ 7769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:57.493737 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:57.493752 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:57.493785 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:57.496535 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.497200 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.497207 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.497209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.497321 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.497646 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.497649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.497651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.497989 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:57.498192 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.498419 (+ 227us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.498571 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:44:57.499677 28381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:57.535874 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.535367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:49992)
0923 19:44:57.535575 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.535691 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260923 19:44:57.536950 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.536540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:50000)
0923 19:44:57.536696 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.536795 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 19:44:57.588363 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 28258
I20260923 19:44:57.597566 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.597012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:50014)
0923 19:44:57.597252 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.597382 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260923 19:44:57.598716 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.598327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:50022)
0923 19:44:57.598492 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.598575 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260923 19:44:57.605362 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 28389
I20260923 19:44:57.619227 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.606081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58350 (local address 127.13.88.195:40623)
0923 19:44:57.606260 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 19:44:57.606264 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:44:57.606328 (+ 64us) server_negotiation.cc:407] Connection header received
0923 19:44:57.606510 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:44:57.606513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:44:57.606576 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:44:57.606656 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:44:57.608492 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.609198 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.610858 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:44:57.611400 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:44:57.611492 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:44:57.613941 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:44:57.613953 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:44:57.613968 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:44:57.613996 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:44:57.616664 (+ 2668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.617385 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.617392 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.617394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.617522 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:44:57.617840 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:44:57.617842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:44:57.617844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:44:57.618149 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:44:57.618366 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0923 19:44:57.618608 (+ 242us) server_negotiation.cc:299] Negotiation successful
0923 19:44:57.618760 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:44:57.619872 28512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:57.679490 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.678954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:50034)
0923 19:44:57.679182 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.679301 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 19:44:57.680550 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:57.680196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:38579 (local address 127.0.0.1:50050)
0923 19:44:57.680380 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:57.680448 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:38579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260923 19:44:57.716674 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 28389
I20260923 19:44:57.733269 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 28035
I20260923 19:44:57.734402 28098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:44:57.847746 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 28035
I20260923 19:44:57.869306 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45683
--webserver_interface=127.13.88.254
--webserver_port=37225
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45683
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:44:58.187148 28565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:58.187446 28565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:58.187600 28565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:58.194662 28565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:44:58.194761 28565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:58.194832 28565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:58.194922 28565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:44:58.194983 28565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:44:58.204492 28565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=37225
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:58.205854 28565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:58.207198 28565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:58.218981 28571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:58.219173 28570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:58.219165 28573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:58.220089 28565 server_base.cc:1034] running on GCE node
I20260923 19:44:58.220811 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:58.222126 28565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:58.223313 28565 hybrid_clock.cc:648] HybridClock initialized: now 1790192698223256 us; error 53 us; skew 500 ppm
I20260923 19:44:58.223691 28565 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:58 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192698, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:58.226541 28565 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:44:58.227968 28565 webserver.cc:460] Webserver started at http://127.13.88.254:37225/ using document root <none> and password file <none>
I20260923 19:44:58.228609 28565 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:58.228749 28565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:58.233947 28565 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260923 19:44:58.236584 28580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:58.237887 28565 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:44:58.238058 28565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "0dd9bc54757a481a86f0d006f08b1223"
format_stamp: "Formatted at 2026-09-23 19:44:52 on dist-test-slave-xg7f"
server_key: "3f097b7319a19da97f4359dd222f35e3"
server_key_iv: "2c63f494b0b12858f452df21d38b5a52"
server_key_version: "encryptionkey@0"
I20260923 19:44:58.238951 28565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:58.271073 28565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:58.274748 28565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:58.275041 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:58.293416 28565 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:45683
I20260923 19:44:58.293426 28631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:45683 every 8 connection(s)
I20260923 19:44:58.294827 28565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:44:58.301465 28632 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:44:58.301517 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28565
I20260923 19:44:58.302269 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:38579
--local_ip_for_outbound_sockets=127.13.88.193
--tserver_master_addrs=127.13.88.254:45683
--webserver_port=39371
--webserver_interface=127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:58.304677 28632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Bootstrap starting.
I20260923 19:44:58.324487 28632 log.cc:824] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:58.340099 28632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:44:58.340619 28632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223: Bootstrap complete.
I20260923 19:44:58.349851 28632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:58.350728 28632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dd9bc54757a481a86f0d006f08b1223, State: Initialized, Role: FOLLOWER
I20260923 19:44:58.351421 28632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:58.351668 28632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:44:58.351805 28632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:44:58.351976 28632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:44:58.355598 28632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:58.356051 28632 leader_election.cc:302] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0dd9bc54757a481a86f0d006f08b1223; no voters:
I20260923 19:44:58.356724 28632 leader_election.cc:288] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 19:44:58.356868 28636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 19:44:58.358192 28636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [term 3 LEADER]: Becoming Leader. State: Replica: 0dd9bc54757a481a86f0d006f08b1223, State: Running, Role: LEADER
I20260923 19:44:58.358707 28636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } }
I20260923 19:44:58.359066 28632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:44:58.361212 28638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0dd9bc54757a481a86f0d006f08b1223. Latest consensus state: current_term: 3 leader_uuid: "0dd9bc54757a481a86f0d006f08b1223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } } }
I20260923 19:44:58.361622 28638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:58.361364 28637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0dd9bc54757a481a86f0d006f08b1223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0dd9bc54757a481a86f0d006f08b1223" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45683 } } }
I20260923 19:44:58.361917 28637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0dd9bc54757a481a86f0d006f08b1223 [sys.catalog]: This master's current role is: LEADER
I20260923 19:44:58.371670 28643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:44:58.380429 28643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:44:58.381954 28643 catalog_manager.cc:1259] Loaded cluster ID: 87436a2185074f2bbcadd21faf79e678
I20260923 19:44:58.382097 28643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260923 19:44:58.384375 28643 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f3f3e3f89ad google::LogMessage::Fail() at ??:0
@ 0x7f3f3e3fb88a google::LogMessage::SendToLog() at ??:0
@ 0x7f3f3e3f84de google::LogMessage::Flush() at ??:0
@ 0x7f3f3e3f9a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3f53e2b512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f3f53e28976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f3f53eb0610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f3f53eb0439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f3f41044345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3f4104791c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f3f41047799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f3f41022eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f3f442fc6db start_thread at ??:0
@ 0x7f3f3d29261f clone at ??:0
W20260923 19:44:58.678332 28634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:58.678602 28634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:58.678761 28634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:58.686748 28634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:58.686842 28634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:58.687021 28634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:44:58.696373 28634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:38579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=39371
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:58.697597 28634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:58.698884 28634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:58.711278 28673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:58.711229 28676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:58.711171 28674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:58.712036 28634 server_base.cc:1034] running on GCE node
I20260923 19:44:58.712556 28634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:58.713501 28634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:58.714694 28634 hybrid_clock.cc:648] HybridClock initialized: now 1790192698714662 us; error 27 us; skew 500 ppm
I20260923 19:44:58.714998 28634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:58 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192698, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:58.718040 28634 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:44:58.719399 28634 webserver.cc:460] Webserver started at http://127.13.88.193:39371/ using document root <none> and password file <none>
I20260923 19:44:58.720072 28634 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:58.720217 28634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:58.725123 28634 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260923 19:44:58.729178 28683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:58.730500 28634 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:44:58.730657 28634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "e14c99314df9424696ff984ff441a892"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "f6968d9e63d90c7cc98d071e14aa31f5"
server_key_iv: "6d5f4d8c1c014f1dbd5fdfe12932515a"
server_key_version: "encryptionkey@0"
I20260923 19:44:58.731724 28634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:58.746117 28634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:58.750298 28634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:58.750571 28634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:58.751528 28634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:58.753175 28690 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260923 19:44:58.758649 28634 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 19:44:58.758791 28634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260923 19:44:58.758927 28634 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 19:44:58.761955 28634 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 19:44:58.762059 28634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260923 19:44:58.762389 28690 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Bootstrap starting.
I20260923 19:44:58.790617 28690 log.cc:824] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Log is configured to *not* fsync() on all Append() calls
I20260923 19:44:58.800869 28634 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:38579
I20260923 19:44:58.800890 28797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:38579 every 8 connection(s)
I20260923 19:44:58.802469 28634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:44:58.804785 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28634
I20260923 19:44:58.805395 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:44089
--local_ip_for_outbound_sockets=127.13.88.194
--tserver_master_addrs=127.13.88.254:45683
--webserver_port=41679
--webserver_interface=127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:58.808087 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:58.805559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:59213)
0923 19:44:58.806541 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:58.806895 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":403,"threads_started":1}
W20260923 19:44:58.808769 28798 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:45683 (0 consecutive failures): Network error: Failed to ping master at 127.13.88.254:45683: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
I20260923 19:44:58.809729 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:58.809324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:43597)
0923 19:44:58.809495 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:58.809577 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260923 19:44:58.810559 28690 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:44:58.810832 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:58.810387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:51113)
0923 19:44:58.810556 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:58.810649 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260923 19:44:58.811152 28798 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:44:58.811267 28690 tablet_bootstrap.cc:492] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Bootstrap complete.
I20260923 19:44:58.812539 28690 ts_tablet_manager.cc:1397] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Time spent bootstrapping tablet: real 0.050s user 0.025s sys 0.023s
I20260923 19:44:58.818555 28690 raft_consensus.cc:348] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:58.819550 28690 raft_consensus.cc:729] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14c99314df9424696ff984ff441a892, State: Initialized, Role: FOLLOWER
I20260923 19:44:58.820117 28690 consensus_queue.cc:260] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:44:58.821595 28690 ts_tablet_manager.cc:1428] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892: Time spent starting tablet: real 0.009s user 0.005s sys 0.005s
I20260923 19:44:58.821909 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:58.821423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:39599)
0923 19:44:58.821605 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:58.821750 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 19:44:58.822863 28800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:58.822565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:43531)
0923 19:44:58.822698 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:58.822757 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:44:59.127493 28801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:59.127758 28801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:59.127929 28801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:59.135541 28801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:59.135644 28801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:59.135914 28801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:44:59.145633 28801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:44089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=41679
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:59.147065 28801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:59.148458 28801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:59.161413 28810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:59.161473 28808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:59.161480 28807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:59.162290 28801 server_base.cc:1034] running on GCE node
I20260923 19:44:59.162964 28801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:59.163904 28801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:59.165104 28801 hybrid_clock.cc:648] HybridClock initialized: now 1790192699165060 us; error 45 us; skew 500 ppm
I20260923 19:44:59.165426 28801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:59 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192699, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:59.168573 28801 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:44:59.169984 28801 webserver.cc:460] Webserver started at http://127.13.88.194:41679/ using document root <none> and password file <none>
I20260923 19:44:59.170650 28801 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:59.170791 28801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:59.176131 28801 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:44:59.178793 28817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:59.180150 28801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:44:59.180327 28801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "a905164abbd1474fa36a4af0fdaff117"
format_stamp: "Formatted at 2026-09-23 19:44:53 on dist-test-slave-xg7f"
server_key: "522fd4f69c3cd17bebf4d8e30ffcde40"
server_key_iv: "56e005ba713cc95cfbecbc813af1e4c2"
server_key_version: "encryptionkey@0"
I20260923 19:44:59.181278 28801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:59.196241 28801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:59.200263 28801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:59.200538 28801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:59.201493 28801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:59.202741 28801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:59.202874 28801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:59.203004 28801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:59.203094 28801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:59.236316 28801 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:44089
I20260923 19:44:59.236363 28929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:44089 every 8 connection(s)
I20260923 19:44:59.238117 28801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:44:59.238950 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28801
I20260923 19:44:59.239707 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:40623
--local_ip_for_outbound_sockets=127.13.88.195
--tserver_master_addrs=127.13.88.254:45683
--webserver_port=33389
--webserver_interface=127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:44:59.243278 28932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:59.241411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:37033)
0923 19:44:59.242172 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:59.242354 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":307,"threads_started":1}
W20260923 19:44:59.243966 28930 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:45683 (0 consecutive failures): Network error: Failed to ping master at 127.13.88.254:45683: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
I20260923 19:44:59.244828 28932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:59.244503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:53195)
0923 19:44:59.244648 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:59.244714 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260923 19:44:59.245654 28932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:59.245339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:36717)
0923 19:44:59.245480 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:59.245552 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:44:59.245867 28930 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 19:44:59.558111 28933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:44:59.558383 28933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:44:59.558579 28933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:44:59.566044 28933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:44:59.566151 28933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:44:59.566344 28933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:44:59.576030 28933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:40623
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=33389
--tserver_master_addrs=127.13.88.254:45683
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:44:59.577291 28933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:44:59.578557 28933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:44:59.591574 28941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:59.591663 28938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:44:59.591666 28939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:44:59.592559 28933 server_base.cc:1034] running on GCE node
I20260923 19:44:59.593140 28933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:44:59.594081 28933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:44:59.595301 28933 hybrid_clock.cc:648] HybridClock initialized: now 1790192699595254 us; error 41 us; skew 500 ppm
I20260923 19:44:59.595606 28933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:44:59 dist-test-slave-xg7f krb5kdc[27484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192699, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:44:59.598701 28933 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:44:59.600162 28933 webserver.cc:460] Webserver started at http://127.13.88.195:33389/ using document root <none> and password file <none>
I20260923 19:44:59.600850 28933 fs_manager.cc:359] Metadata directory not provided
I20260923 19:44:59.600989 28933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:44:59.606102 28933 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 19:44:59.608868 28948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:59.610234 28933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:44:59.610467 28933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "bce1b165be434d8eaf89b793afc240b4"
format_stamp: "Formatted at 2026-09-23 19:44:54 on dist-test-slave-xg7f"
server_key: "e9fb47db068dd6beec31020d415a9873"
server_key_iv: "44845cbc00aa3282987585a58a4b6e0b"
server_key_version: "encryptionkey@0"
I20260923 19:44:59.611541 28933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:44:59.629267 28933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:44:59.633710 28933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:44:59.633996 28933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:44:59.635018 28933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:44:59.636432 28933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:44:59.636560 28933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:59.636695 28933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:44:59.636785 28933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:44:59.676330 28933 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:40623
I20260923 19:44:59.676393 29060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:40623 every 8 connection(s)
I20260923 19:44:59.678901 28933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:44:59.683132 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 28933
I20260923 19:44:59.685565 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:59.682885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:53909)
0923 19:44:59.683863 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:59.684144 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":395,"threads_started":1}
W20260923 19:44:59.686426 29061 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:45683 (0 consecutive failures): Network error: Failed to ping master at 127.13.88.254:45683: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
I20260923 19:44:59.687438 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:59.687005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:56735)
0923 19:44:59.687205 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:59.687294 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 19:44:59.688421 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:59.687957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:58569)
0923 19:44:59.688109 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:59.688255 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260923 19:44:59.688664 29061 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:44:59.824532 29065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:44:59.823766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:52641)
0923 19:44:59.824228 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0923 19:44:59.824336 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":227,"threads_started":1}
I20260923 19:45:00.247249 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:00.246406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:55483)
0923 19:45:00.246839 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:00.246958 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":207,"threads_started":1}
I20260923 19:45:00.680810 29067 raft_consensus.cc:482] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:45:00.681146 29067 raft_consensus.cc:504] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:45:00.682647 29067 leader_election.cc:288] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
I20260923 19:45:00.690529 29072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:00.689155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:39195)
0923 19:45:00.690010 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:00.690220 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":583,"threads_started":1}
Sep 23 19:45:00 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192698, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
Sep 23 19:45:00 dist-test-slave-xg7f krb5kdc[27484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192698, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:45:00.704385 29071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:00.683594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:35151 (local address 127.13.88.194:44089)
0923 19:45:00.684297 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:00.684312 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:00.684392 (+ 80us) server_negotiation.cc:407] Connection header received
0923 19:45:00.686150 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:00.686158 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:00.686480 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:00.686803 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:00.688989 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.690527 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.693318 (+ 2791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.694082 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.694288 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:00.697838 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:00.697845 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:00.697856 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:00.697892 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:00.700752 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:00.701510 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:00.701516 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:00.701522 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:00.701659 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:00.702105 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:00.702114 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:00.702116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:00.702755 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:00.702941 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:00.703786 (+ 845us) server_negotiation.cc:299] Negotiation successful
0923 19:45:00.704098 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":304,"threads_started":1}
I20260923 19:45:00.704583 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:00.682809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:40623 (local address 127.13.88.193:43831)
0923 19:45:00.683565 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:00.683607 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:00.684460 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:00.686906 (+ 2446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:00.686917 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:00.687812 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:00.688566 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:00.688585 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.690828 (+ 2243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.690834 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:00.692991 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:00.693010 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.693979 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.693985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:00.694242 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:00.694921 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:00.694944 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:00.697279 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:00.700809 (+ 3530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:00.700821 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:00.700837 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:00.701362 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:00.701764 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:00.701769 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:00.701772 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:00.701975 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:00.702800 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:00.702811 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:00.703211 (+ 400us) client_negotiation.cc:769] Sending connection context
0923 19:45:00.703524 (+ 313us) client_negotiation.cc:240] Negotiation successful
0923 19:45:00.704094 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"mutex_wait_us":257,"spinlock_wait_cycles":25344,"thread_start_us":469,"threads_started":1}
I20260923 19:45:00.704775 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:00.682996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:44089 (local address 127.13.88.193:35151)
0923 19:45:00.683846 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:00.683861 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:00.684130 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:00.686905 (+ 2775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:00.686928 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:00.687812 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:00.688566 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:00.688584 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.690764 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.690770 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:00.693147 (+ 2377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:00.693163 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.694282 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.694289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:00.694488 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:00.695141 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:00.695166 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:00.697573 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:00.700889 (+ 3316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:00.700895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:00.700899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:00.701361 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:00.701773 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:00.701779 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:00.701786 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:00.701985 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:00.703008 (+ 1023us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:00.703013 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:00.703211 (+ 198us) client_negotiation.cc:769] Sending connection context
0923 19:45:00.703524 (+ 313us) client_negotiation.cc:240] Negotiation successful
0923 19:45:00.704206 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"mutex_wait_us":384,"spinlock_wait_cycles":37376,"thread_start_us":534,"threads_started":1}
I20260923 19:45:00.705560 29070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:00.683137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:43831 (local address 127.13.88.195:40623)
0923 19:45:00.684594 (+ 1457us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:00.684603 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:00.684627 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:45:00.686097 (+ 1470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:00.686106 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:00.686438 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:00.686768 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:00.688752 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.690610 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.693135 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:00.693786 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:00.693972 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:00.697573 (+ 3601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:00.697581 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:00.697595 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:00.697633 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:00.700657 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:00.701502 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:00.701509 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:00.701515 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:00.701650 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:00.702091 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:00.702099 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:00.702101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:00.702641 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:00.702834 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:00.704878 (+ 2044us) server_negotiation.cc:299] Negotiation successful
0923 19:45:00.705299 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1271,"thread_start_us":1137,"threads_started":1}
W20260923 19:45:00.708123 28686 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
W20260923 19:45:00.708419 28684 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:45:00.708567 28684 leader_election.cc:302] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e14c99314df9424696ff984ff441a892; no voters: a905164abbd1474fa36a4af0fdaff117, bce1b165be434d8eaf89b793afc240b4
I20260923 19:45:00.708963 29067 raft_consensus.cc:2726] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:45:00.825747 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:00.825370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:34717)
0923 19:45:00.825520 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:00.825605 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 19:45:01.248772 29073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:01.248083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:47997)
0923 19:45:01.248535 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:01.248622 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":265,"threads_started":1}
I20260923 19:45:01.692251 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:01.691591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:44863)
0923 19:45:01.692021 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:01.692098 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":247,"threads_started":1}
I20260923 19:45:01.827406 29075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:01.826587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:35991)
0923 19:45:01.827090 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:01.827228 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":243,"threads_started":1}
I20260923 19:45:02.250258 29076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:02.249599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:34039)
0923 19:45:02.250018 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:02.250093 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":214,"threads_started":1}
I20260923 19:45:02.641921 29077 raft_consensus.cc:482] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:45:02.642109 29077 raft_consensus.cc:504] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:45:02.642935 29077 leader_election.cc:288] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
W20260923 19:45:02.643970 28684 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
W20260923 19:45:02.644150 28686 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:45:02.644321 28686 leader_election.cc:302] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e14c99314df9424696ff984ff441a892; no voters: a905164abbd1474fa36a4af0fdaff117, bce1b165be434d8eaf89b793afc240b4
I20260923 19:45:02.644585 29077 raft_consensus.cc:2726] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:45:02.693739 29078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:02.693018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:58025)
0923 19:45:02.693456 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:02.693546 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":241,"threads_started":1}
I20260923 19:45:02.828996 29079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:02.828264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:36395)
0923 19:45:02.828708 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:02.828814 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":210,"threads_started":1}
I20260923 19:45:03.251986 29080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:03.251264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:33453)
0923 19:45:03.251708 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:03.251804 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":218,"threads_started":1}
I20260923 19:45:03.695400 29081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:03.694683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:60221)
0923 19:45:03.695090 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:03.695229 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":220,"threads_started":1}
I20260923 19:45:03.830901 29082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:03.830152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:46035)
0923 19:45:03.830573 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:03.830659 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":219,"threads_started":1}
I20260923 19:45:04.211879 29083 raft_consensus.cc:482] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:45:04.212149 29083 raft_consensus.cc:504] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:45:04.212893 29083 leader_election.cc:288] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
W20260923 19:45:04.213941 28684 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
W20260923 19:45:04.214150 28686 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:45:04.214282 28686 leader_election.cc:302] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e14c99314df9424696ff984ff441a892; no voters: a905164abbd1474fa36a4af0fdaff117, bce1b165be434d8eaf89b793afc240b4
I20260923 19:45:04.214519 29083 raft_consensus.cc:2726] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:45:04.253567 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:04.252917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:44011)
0923 19:45:04.253331 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:04.253407 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":230,"threads_started":1}
I20260923 19:45:04.696972 29085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:04.696282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:60455)
0923 19:45:04.696729 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:04.696810 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":241,"threads_started":1}
I20260923 19:45:04.832546 29086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:04.831853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:48913)
0923 19:45:04.832286 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:04.832366 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":232,"threads_started":1}
I20260923 19:45:05.255050 29087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:05.254345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:53257)
0923 19:45:05.254799 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:05.254882 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":242,"threads_started":1}
I20260923 19:45:05.698805 29088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:05.698022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:58843)
0923 19:45:05.698551 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:05.698638 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":322,"threads_started":1}
I20260923 19:45:05.834040 29089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:05.833370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:57501)
0923 19:45:05.833777 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:05.833859 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":214,"threads_started":1}
I20260923 19:45:06.256800 29090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:06.255958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:52825)
0923 19:45:06.256518 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:06.256604 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":267,"threads_started":1}
I20260923 19:45:06.700546 29091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:06.699722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:41475)
0923 19:45:06.700273 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:06.700367 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":289,"threads_started":1}
I20260923 19:45:06.835850 29092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:06.834980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:46947)
0923 19:45:06.835563 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:06.835658 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":347,"threads_started":1}
I20260923 19:45:07.258610 29093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:07.257758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:56401)
0923 19:45:07.258266 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:07.258365 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":259,"threads_started":1}
I20260923 19:45:07.702032 29094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:07.701345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:46383)
0923 19:45:07.701789 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:07.701865 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":238,"threads_started":1}
I20260923 19:45:07.837401 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:07.836703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:48089)
0923 19:45:07.837127 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:07.837228 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":232,"threads_started":1}
I20260923 19:45:08.260185 29096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:08.259513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:37951)
0923 19:45:08.259941 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:08.260023 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":218,"threads_started":1}
I20260923 19:45:08.592233 29097 raft_consensus.cc:482] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:45:08.592427 29097 raft_consensus.cc:504] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:45:08.593050 29097 leader_election.cc:288] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
W20260923 19:45:08.594010 28686 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
W20260923 19:45:08.594240 28684 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:45:08.594401 28684 leader_election.cc:302] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e14c99314df9424696ff984ff441a892; no voters: a905164abbd1474fa36a4af0fdaff117, bce1b165be434d8eaf89b793afc240b4
I20260923 19:45:08.594681 29097 raft_consensus.cc:2726] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:45:08.703856 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:08.703019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:39557)
0923 19:45:08.703599 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:08.703696 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":359,"threads_started":1}
I20260923 19:45:08.839306 29099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:08.838458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:41587)
0923 19:45:08.838928 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:08.839035 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":250,"threads_started":1}
I20260923 19:45:09.261845 29100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:09.261103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:36739)
0923 19:45:09.261587 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:09.261668 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":272,"threads_started":1}
I20260923 19:45:09.705705 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:09.704828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:58593)
0923 19:45:09.705373 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:09.705479 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":258,"threads_started":1}
I20260923 19:45:09.840912 29102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:09.840248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:59811)
0923 19:45:09.840653 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:09.840734 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":205,"threads_started":1}
I20260923 19:45:10.263592 29103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:10.262815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:46487)
0923 19:45:10.263340 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:10.263426 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":310,"threads_started":1}
I20260923 19:45:10.707407 29104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:10.706653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:60085)
0923 19:45:10.707160 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:10.707243 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":232,"threads_started":1}
I20260923 19:45:10.842585 29105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:10.841884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:57447)
0923 19:45:10.842315 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:10.842391 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":222,"threads_started":1}
I20260923 19:45:11.265322 29106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:11.264550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:59961)
0923 19:45:11.265046 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:11.265141 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":263,"threads_started":1}
I20260923 19:45:11.709025 29107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:11.708330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:42957)
0923 19:45:11.708747 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:11.708861 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":225,"threads_started":1}
I20260923 19:45:11.844328 29108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:11.843648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:55209)
0923 19:45:11.844079 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:11.844162 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":237,"threads_started":1}
I20260923 19:45:12.266980 29109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:12.266229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:54703)
0923 19:45:12.266677 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:12.266814 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":243,"threads_started":1}
I20260923 19:45:12.710721 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:12.710027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:50341)
0923 19:45:12.710478 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:12.710562 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":237,"threads_started":1}
I20260923 19:45:12.845965 29111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:12.845250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:60699)
0923 19:45:12.845681 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:12.845772 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":229,"threads_started":1}
I20260923 19:45:13.268544 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:13.267849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:48283)
0923 19:45:13.268254 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:13.268352 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":216,"threads_started":1}
I20260923 19:45:13.554901 29113 raft_consensus.cc:482] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:45:13.555075 29113 raft_consensus.cc:504] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bce1b165be434d8eaf89b793afc240b4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40623 } } peers { permanent_uuid: "a905164abbd1474fa36a4af0fdaff117" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 44089 } } peers { permanent_uuid: "e14c99314df9424696ff984ff441a892" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 38579 } }
I20260923 19:45:13.555805 29113 leader_election.cc:288] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623), a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089)
W20260923 19:45:13.556676 28684 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bce1b165be434d8eaf89b793afc240b4 (127.13.88.195:40623): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
W20260923 19:45:13.556867 28686 leader_election.cc:341] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a905164abbd1474fa36a4af0fdaff117 (127.13.88.194:44089): Not found: Tablet not found: 4501197b6d7a4cd48b8c0c8ad887034f
I20260923 19:45:13.556996 28686 leader_election.cc:302] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e14c99314df9424696ff984ff441a892; no voters: a905164abbd1474fa36a4af0fdaff117, bce1b165be434d8eaf89b793afc240b4
I20260923 19:45:13.557279 29113 raft_consensus.cc:2726] T 4501197b6d7a4cd48b8c0c8ad887034f P e14c99314df9424696ff984ff441a892 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:45:13.712308 29114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:13.711612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:38615)
0923 19:45:13.712040 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:13.712122 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":226,"threads_started":1}
I20260923 19:45:13.848055 29115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:13.847246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.193:36317)
0923 19:45:13.847750 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:13.847859 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":223,"threads_started":1}
I20260923 19:45:14.270363 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:14.269688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.194:34947)
0923 19:45:14.270101 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:14.270193 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":198,"threads_started":1}
I20260923 19:45:14.694073 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 28634
I20260923 19:45:14.709378 29117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:14.695504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39904 (local address 127.13.88.193:38579)
0923 19:45:14.696325 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:14.696341 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:14.696472 (+ 131us) server_negotiation.cc:407] Connection header received
0923 19:45:14.696635 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:14.696643 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:14.696883 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:14.697041 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:14.698429 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:14.699515 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:14.700724 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:14.701259 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:14.701354 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:14.704062 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:14.704074 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:14.704088 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:14.704133 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:14.706993 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:14.707671 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:14.707678 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:14.707680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:14.707814 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:14.708131 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:14.708134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:14.708136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:14.708477 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:14.708692 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:14.708900 (+ 208us) server_negotiation.cc:299] Negotiation successful
0923 19:45:14.709095 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":428,"threads_started":1}
I20260923 19:45:14.710614 28793 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:14.714388 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:14.713368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:45683 (local address 127.13.88.195:59009)
0923 19:45:14.713958 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:14.714137 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:45683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":244,"threads_started":1}
I20260923 19:45:14.801658 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 28634
I20260923 19:45:14.819357 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 28801
I20260923 19:45:14.832733 29120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:14.820114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45796 (local address 127.13.88.194:44089)
0923 19:45:14.820648 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:14.820652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:14.820667 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:45:14.820721 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:14.820725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:14.820780 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:14.820901 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:14.822223 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:14.823011 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:14.824351 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:14.824786 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:14.824932 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:14.827598 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:14.827603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:14.827606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:14.827640 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:14.830050 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:14.830691 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:14.830698 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:14.830701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:14.830850 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:14.831299 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:14.831303 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:14.831305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:14.831559 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:14.831828 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:14.832119 (+ 291us) server_negotiation.cc:299] Negotiation successful
0923 19:45:14.832349 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":311,"threads_started":1}
I20260923 19:45:14.833474 28925 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:14.917531 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 28801
I20260923 19:45:14.935489 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 28933
I20260923 19:45:14.948307 29122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:14.936283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49282 (local address 127.13.88.195:40623)
0923 19:45:14.936834 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:14.936839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:14.936856 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:45:14.936911 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:14.936915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:14.936990 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:14.937089 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:14.938385 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:14.939183 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:14.940302 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:14.940714 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:14.940839 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:14.943415 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:14.943420 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:14.943423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:14.943453 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:14.946100 (+ 2647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:14.946714 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:14.946717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:14.946720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:14.946855 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:14.947211 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:14.947214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:14.947216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:14.947466 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:14.947651 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:14.947869 (+ 218us) server_negotiation.cc:299] Negotiation successful
0923 19:45:14.948024 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":302,"threads_started":1}
I20260923 19:45:14.948976 29056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:15.033252 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 28933
2026-09-23T19:45:15Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24311 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:45:15 dist-test-slave-xg7f krb5kdc[29126](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:45:15 dist-test-slave-xg7f krb5kdc[29126](info): set up 2 sockets
Sep 23 19:45:15 dist-test-slave-xg7f krb5kdc[29126](info): commencing operation
krb5kdc: starting...
W20260923 19:45:16.127832 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:45:16 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:45:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:45:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:45:16.364701 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35983
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:35983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:45:16.690490 29139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:16.690871 29139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:16.691031 29139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:16.698454 29139 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 19:45:16.698593 29139 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 19:45:16.698690 29139 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 19:45:16.698791 29139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:45:16.698889 29139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:16.698992 29139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:16.699077 29139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:45:16.699175 29139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:45:16.709188 29139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:35983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:16.710521 29139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:16.711954 29139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:16.723763 29145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:16.724186 29144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:16.724287 29147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:16.724473 29139 server_base.cc:1034] running on GCE node
I20260923 19:45:16.725559 29139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:16.726953 29139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:16.728173 29139 hybrid_clock.cc:648] HybridClock initialized: now 1790192716728113 us; error 32 us; skew 500 ppm
I20260923 19:45:16.728513 29139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:16 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192716, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:16.731600 29139 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:45:16.733063 29139 webserver.cc:460] Webserver started at http://127.13.88.254:37469/ using document root <none> and password file <none>
I20260923 19:45:16.733758 29139 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:16.733877 29139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:16.734174 29139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:45:16.737149 29139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "596a86ffb523483889e1ce0313d682e5"
format_stamp: "Formatted at 2026-09-23 19:45:16 on dist-test-slave-xg7f"
server_key: "3ca7e0454830ab573656728e65fb6960"
server_key_iv: "6a8781077dd4b90ded169b07bcc47c5b"
server_key_version: "encryptionkey@0"
I20260923 19:45:16.737918 29139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "596a86ffb523483889e1ce0313d682e5"
format_stamp: "Formatted at 2026-09-23 19:45:16 on dist-test-slave-xg7f"
server_key: "3ca7e0454830ab573656728e65fb6960"
server_key_iv: "6a8781077dd4b90ded169b07bcc47c5b"
server_key_version: "encryptionkey@0"
I20260923 19:45:16.742882 29139 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260923 19:45:16.746392 29154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:16.748375 29139 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:45:16.748554 29139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "596a86ffb523483889e1ce0313d682e5"
format_stamp: "Formatted at 2026-09-23 19:45:16 on dist-test-slave-xg7f"
server_key: "3ca7e0454830ab573656728e65fb6960"
server_key_iv: "6a8781077dd4b90ded169b07bcc47c5b"
server_key_version: "encryptionkey@0"
I20260923 19:45:16.748831 29139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:16.769915 29139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:16.773983 29139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:16.774202 29139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:16.792260 29139 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:35983
I20260923 19:45:16.792273 29205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:35983 every 8 connection(s)
I20260923 19:45:16.793598 29139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:45:16.797585 29206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:45:16.798178 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 29139
I20260923 19:45:16.798398 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:45:16.799269 13667 external_mini_cluster.cc:1428] Setting key 168dca6f621a817d1c7c58a44fd1434a
I20260923 19:45:16.811864 29206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Bootstrap starting.
Sep 23 19:45:16 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:45:16.815537 29206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Neither blocks nor log segments found. Creating new log.
I20260923 19:45:16.816599 29206 log.cc:824] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:16.819588 29206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: No bootstrap required, opened a new log
I20260923 19:45:16.822371 29209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:16.801511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56198 (local address 127.13.88.254:35983)
0923 19:45:16.802282 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:16.802296 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:16.802337 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:45:16.804074 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:16.804099 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:16.804497 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:16.804818 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:16.806590 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:16.807914 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:16.809862 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:16.810516 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:16.810648 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:16.815255 (+ 4607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:16.815264 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:16.815279 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:16.815313 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:16.818353 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:16.819054 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:16.819067 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:16.819072 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:16.819289 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:16.819667 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:16.819674 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:16.819677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:16.820195 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:16.820517 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:16.820933 (+ 416us) server_negotiation.cc:299] Negotiation successful
0923 19:45:16.821386 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":365,"threads_started":1}
I20260923 19:45:16.827327 29206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:16.827680 29206 raft_consensus.cc:374] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:45:16.827780 29206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 596a86ffb523483889e1ce0313d682e5, State: Initialized, Role: FOLLOWER
I20260923 19:45:16.828300 29206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:16.828527 29206 raft_consensus.cc:388] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:45:16.828655 29206 raft_consensus.cc:482] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:45:16.828807 29206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:45:16.831204 29206 raft_consensus.cc:504] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:16.831724 29206 leader_election.cc:302] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 596a86ffb523483889e1ce0313d682e5; no voters:
I20260923 19:45:16.832212 29206 leader_election.cc:288] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:45:16.832383 29211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:45:16.833035 29211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 LEADER]: Becoming Leader. State: Replica: 596a86ffb523483889e1ce0313d682e5, State: Running, Role: LEADER
I20260923 19:45:16.833572 29211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:16.834201 29206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:45:16.836638 29213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 596a86ffb523483889e1ce0313d682e5. Latest consensus state: current_term: 1 leader_uuid: "596a86ffb523483889e1ce0313d682e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } } }
I20260923 19:45:16.836855 29212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "596a86ffb523483889e1ce0313d682e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } } }
I20260923 19:45:16.837123 29213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:45:16.837163 29212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:45:16.839764 29220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:45:16.844926 29220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:45:16.854271 29220 catalog_manager.cc:1347] Generated new cluster ID: 64f38519eb89481dba42b7f71f27a693
I20260923 19:45:16.854408 29220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:45:16.863579 29220 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:45:16.865098 29220 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:45:16.875523 29220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Generated new TSK 0
I20260923 19:45:16.876504 29220 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:45:16.941305 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:35983
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:45:17.270287 29232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:17.270622 29232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:17.270792 29232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:17.278045 29232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:17.278203 29232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:17.278393 29232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:45:17.288086 29232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:17.289415 29232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:17.290747 29232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:17.303745 29237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:17.303664 29238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:17.303701 29240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:17.305087 29232 server_base.cc:1034] running on GCE node
I20260923 19:45:17.305702 29232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:17.306648 29232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:17.307870 29232 hybrid_clock.cc:648] HybridClock initialized: now 1790192717307821 us; error 44 us; skew 500 ppm
I20260923 19:45:17.308184 29232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:17 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192717, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:17.311244 29232 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:45:17.312711 29232 webserver.cc:460] Webserver started at http://127.13.88.193:43209/ using document root <none> and password file <none>
I20260923 19:45:17.313390 29232 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:17.313524 29232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:17.313817 29232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:45:17.316687 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "8b90c5fa6b37485285f4074892796751"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "425326d12b3d876d78ceb93d6b2ac929"
server_key_iv: "49a03076ac6052bd8851b93e1dc70344"
server_key_version: "encryptionkey@0"
I20260923 19:45:17.317468 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "8b90c5fa6b37485285f4074892796751"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "425326d12b3d876d78ceb93d6b2ac929"
server_key_iv: "49a03076ac6052bd8851b93e1dc70344"
server_key_version: "encryptionkey@0"
I20260923 19:45:17.322810 29232 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:45:17.326578 29247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:17.328048 29232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:45:17.328236 29232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "8b90c5fa6b37485285f4074892796751"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "425326d12b3d876d78ceb93d6b2ac929"
server_key_iv: "49a03076ac6052bd8851b93e1dc70344"
server_key_version: "encryptionkey@0"
I20260923 19:45:17.328455 29232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:17.358937 29232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:17.363009 29232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:17.363336 29232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:17.364331 29232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:45:17.365618 29232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:45:17.365736 29232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:17.365872 29232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:45:17.365948 29232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:17.399237 29232 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:40281
I20260923 19:45:17.399277 29359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:40281 every 8 connection(s)
I20260923 19:45:17.400475 29232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:45:17.407255 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 29232
I20260923 19:45:17.407482 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:45:17.408280 13667 external_mini_cluster.cc:1428] Setting key 68790cfb0117ad4752e493174100e303
Sep 23 19:45:17 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192717, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:45:17.420666 29362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:17.403197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:45537 (local address 127.13.88.254:35983)
0923 19:45:17.403626 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:17.403631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:17.404635 (+ 1004us) server_negotiation.cc:407] Connection header received
0923 19:45:17.406381 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:17.406386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:17.406450 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:17.406543 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:17.408622 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.409305 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.410859 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.411341 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.411481 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:17.414907 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:17.414913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:17.414916 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:17.414947 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:17.417519 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:17.418243 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:17.418250 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:17.418253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:17.418378 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:17.418842 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:17.418848 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:17.418851 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:17.419192 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:17.419359 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:17.420081 (+ 722us) server_negotiation.cc:299] Negotiation successful
0923 19:45:17.420313 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":214,"threads_started":1}
I20260923 19:45:17.421705 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:17.403797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:45537)
0923 19:45:17.404466 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:17.404507 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:17.406113 (+ 1606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:17.406808 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:17.406821 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:17.407606 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:17.408436 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:17.408463 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.409477 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.409482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:17.410694 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:17.410706 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.411575 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.411584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:17.411832 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:17.412518 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:17.412539 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:17.414689 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:17.417672 (+ 2983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:17.417681 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:17.417699 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:17.418115 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:17.418486 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:17.418491 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:17.418495 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:17.418724 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:17.419325 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:17.419333 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:17.419703 (+ 370us) client_negotiation.cc:769] Sending connection context
0923 19:45:17.419993 (+ 290us) client_negotiation.cc:240] Negotiation successful
0923 19:45:17.420535 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":283,"threads_started":1}
I20260923 19:45:17.423430 29360 heartbeater.cc:347] Connected to a master server at 127.13.88.254:35983
I20260923 19:45:17.423780 29360 heartbeater.cc:464] Registering TS with master...
I20260923 19:45:17.424702 29360 heartbeater.cc:511] Master 127.13.88.254:35983 requested a full tablet report, sending...
I20260923 19:45:17.427379 29171 ts_manager.cc:194] Registered new tserver with Master: 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281)
I20260923 19:45:17.429764 29171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:45537
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:45:17.462122 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:35983
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:45:17.796270 29366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:17.796597 29366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:17.796741 29366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:17.808432 29366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:17.808579 29366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:17.808770 29366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:45:17.819826 29366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:17.821046 29366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:17.822341 29366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:17.835356 29371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:17.835371 29372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:17.835464 29374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:17.836373 29366 server_base.cc:1034] running on GCE node
I20260923 19:45:17.836928 29366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:17.837883 29366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:17.839146 29366 hybrid_clock.cc:648] HybridClock initialized: now 1790192717839063 us; error 55 us; skew 500 ppm
I20260923 19:45:17.839475 29366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:17 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192717, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:17.842517 29366 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:45:17.844000 29366 webserver.cc:460] Webserver started at http://127.13.88.194:34349/ using document root <none> and password file <none>
I20260923 19:45:17.844686 29366 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:17.844836 29366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:17.845144 29366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:45:17.848132 29366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "9d9fa0dd730040149d80191b915a3aa9"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "e77134945acbdcc110bbee409d2e65b4"
server_key_iv: "e68bf69058b57716d477b41742f2d241"
server_key_version: "encryptionkey@0"
I20260923 19:45:17.848902 29366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "9d9fa0dd730040149d80191b915a3aa9"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "e77134945acbdcc110bbee409d2e65b4"
server_key_iv: "e68bf69058b57716d477b41742f2d241"
server_key_version: "encryptionkey@0"
I20260923 19:45:17.854266 29366 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:45:17.857849 29381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:17.859283 29366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:45:17.859450 29366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "9d9fa0dd730040149d80191b915a3aa9"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "e77134945acbdcc110bbee409d2e65b4"
server_key_iv: "e68bf69058b57716d477b41742f2d241"
server_key_version: "encryptionkey@0"
I20260923 19:45:17.859644 29366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:17.884056 29366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:17.888118 29366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:17.888413 29366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:17.889374 29366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:45:17.890764 29366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:45:17.890895 29366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:17.891042 29366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:45:17.891148 29366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:17.925128 29366 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:41275
I20260923 19:45:17.925225 29493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:41275 every 8 connection(s)
I20260923 19:45:17.926429 29366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:45:17.929299 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 29366
I20260923 19:45:17.929467 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:45:17.930055 13667 external_mini_cluster.cc:1428] Setting key cd5b1ebe70e1f6eb3a91c46ab7044f9e
Sep 23 19:45:17 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192717, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:45:17.948935 29496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:17.929012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:49321 (local address 127.13.88.254:35983)
0923 19:45:17.929518 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:17.929526 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:17.930641 (+ 1115us) server_negotiation.cc:407] Connection header received
0923 19:45:17.933012 (+ 2371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:17.933016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:17.933083 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:17.933172 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:17.935387 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.936234 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.938847 (+ 2613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.939435 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.939527 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:17.943245 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:17.943250 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:17.943254 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:17.943286 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:17.945751 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:17.946485 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:17.946490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:17.946494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:17.946634 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:17.947088 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:17.947136 (+ 48us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:17.947142 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:17.947423 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:17.947599 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:17.948293 (+ 694us) server_negotiation.cc:299] Negotiation successful
0923 19:45:17.948539 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":270,"threads_started":1}
I20260923 19:45:17.949913 29497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:17.929632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:49321)
0923 19:45:17.930484 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:17.930523 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:17.932701 (+ 2178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:17.933450 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:17.933465 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:17.934335 (+ 870us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:17.935213 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:17.935242 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.936414 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.936422 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:17.938704 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:17.938722 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:17.939650 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:17.939659 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:17.940002 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:17.940736 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:17.940773 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:17.942992 (+ 2219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:17.945903 (+ 2911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:17.945914 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:17.945932 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:17.946349 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:17.946748 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:17.946753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:17.946757 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:17.946965 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:17.947562 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:17.947570 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:17.947939 (+ 369us) client_negotiation.cc:769] Sending connection context
0923 19:45:17.948201 (+ 262us) client_negotiation.cc:240] Negotiation successful
0923 19:45:17.948725 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":332,"threads_started":1}
I20260923 19:45:17.951498 29494 heartbeater.cc:347] Connected to a master server at 127.13.88.254:35983
I20260923 19:45:17.951815 29494 heartbeater.cc:464] Registering TS with master...
I20260923 19:45:17.952634 29494 heartbeater.cc:511] Master 127.13.88.254:35983 requested a full tablet report, sending...
I20260923 19:45:17.954252 29171 ts_manager.cc:194] Registered new tserver with Master: 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:45:17.955158 29171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:49321
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:45:17.983527 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:35983
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:45:18.310201 29500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:18.310485 29500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:18.310664 29500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:18.318070 29500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:18.318181 29500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:18.318359 29500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:45:18.328209 29500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:18.329469 29500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:18.330821 29500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:18.344362 29505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:18.344421 29506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:18.344600 29508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:18.345223 29500 server_base.cc:1034] running on GCE node
I20260923 19:45:18.345760 29500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:18.346643 29500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:18.347855 29500 hybrid_clock.cc:648] HybridClock initialized: now 1790192718347816 us; error 35 us; skew 500 ppm
I20260923 19:45:18.348184 29500 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:18 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192718, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:18.351382 29500 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:45:18.352977 29500 webserver.cc:460] Webserver started at http://127.13.88.195:35719/ using document root <none> and password file <none>
I20260923 19:45:18.353776 29500 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:18.353920 29500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:18.354228 29500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:45:18.357189 29500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "5d5829202cd2491cad8a0da7a4783192"
format_stamp: "Formatted at 2026-09-23 19:45:18 on dist-test-slave-xg7f"
server_key: "af5d98242c9f2c6912417bba16719a6b"
server_key_iv: "b45c934dc03223636c8b972f9b8df773"
server_key_version: "encryptionkey@0"
I20260923 19:45:18.357962 29500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "5d5829202cd2491cad8a0da7a4783192"
format_stamp: "Formatted at 2026-09-23 19:45:18 on dist-test-slave-xg7f"
server_key: "af5d98242c9f2c6912417bba16719a6b"
server_key_iv: "b45c934dc03223636c8b972f9b8df773"
server_key_version: "encryptionkey@0"
I20260923 19:45:18.363440 29500 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:45:18.366895 29515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:18.368261 29500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:45:18.368438 29500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "5d5829202cd2491cad8a0da7a4783192"
format_stamp: "Formatted at 2026-09-23 19:45:18 on dist-test-slave-xg7f"
server_key: "af5d98242c9f2c6912417bba16719a6b"
server_key_iv: "b45c934dc03223636c8b972f9b8df773"
server_key_version: "encryptionkey@0"
I20260923 19:45:18.368634 29500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:18.384702 29500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:18.389320 29500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:18.389627 29500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:18.390667 29500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:45:18.392068 29500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:45:18.392172 29500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:18.392336 29500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:45:18.392413 29500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:18.425542 29500 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:35637
I20260923 19:45:18.425585 29627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:35637 every 8 connection(s)
I20260923 19:45:18.426813 29500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:45:18.433759 29360 heartbeater.cc:503] Master 127.13.88.254:35983 was elected leader, sending a full tablet report...
I20260923 19:45:18.436214 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 29500
I20260923 19:45:18.436434 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:45:18.436982 13667 external_mini_cluster.cc:1428] Setting key 8577b20e06b50643386b51903c5bb041
Sep 23 19:45:18 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192718, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:45:18.447755 29496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.429324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:41603 (local address 127.13.88.254:35983)
0923 19:45:18.429501 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.429506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.430660 (+ 1154us) server_negotiation.cc:407] Connection header received
0923 19:45:18.432610 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.432616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.432709 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.432818 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:18.434664 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.435586 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.437860 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.438509 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.438643 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.442295 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:18.442301 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:18.442305 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:18.442336 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:18.444795 (+ 2459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.445500 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.445512 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.445515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.445631 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.446070 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.446078 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.446081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.446364 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:18.446542 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.447208 (+ 666us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.447435 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:45:18.448704 29630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.429834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:41603)
0923 19:45:18.430502 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.430546 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:18.432300 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:18.433059 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:18.433067 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:18.433691 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:18.434489 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.434515 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.435736 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.435741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.437699 (+ 1958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.437710 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.438740 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.438756 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.439052 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.439850 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:18.439883 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:18.442090 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:18.444935 (+ 2845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:18.444944 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:18.444960 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:18.445375 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:18.445739 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:18.445744 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:18.445748 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:18.445961 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:18.446489 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:18.446497 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:18.446844 (+ 347us) client_negotiation.cc:769] Sending connection context
0923 19:45:18.447107 (+ 263us) client_negotiation.cc:240] Negotiation successful
0923 19:45:18.447641 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":257,"threads_started":1}
I20260923 19:45:18.450012 29628 heartbeater.cc:347] Connected to a master server at 127.13.88.254:35983
I20260923 19:45:18.450269 29628 heartbeater.cc:464] Registering TS with master...
I20260923 19:45:18.451095 29628 heartbeater.cc:511] Master 127.13.88.254:35983 requested a full tablet report, sending...
I20260923 19:45:18.452744 29171 ts_manager.cc:194] Registered new tserver with Master: 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637)
I20260923 19:45:18.453536 29171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:41603
I20260923 19:45:18.465088 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:45:18.482476 29496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.469448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56204 (local address 127.13.88.254:35983)
0923 19:45:18.469655 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.469663 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.470027 (+ 364us) server_negotiation.cc:407] Connection header received
0923 19:45:18.470243 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.470254 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.470327 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.470446 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:18.471921 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.472640 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.474007 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.474418 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.474559 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.477150 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:18.477156 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:18.477159 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:18.477193 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:18.479733 (+ 2540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.480482 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.480494 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.480496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.480623 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.481007 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.481012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.481016 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.481350 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:18.481622 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.481912 (+ 290us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.482141 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:45:18.486507 29171 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:45:18.493374 29171 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:45:18.516090 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.505674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48946 (local address 127.13.88.193:40281)
0923 19:45:18.506957 (+ 1283us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.506970 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.507005 (+ 35us) server_negotiation.cc:407] Connection header received
0923 19:45:18.507136 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.507145 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.507420 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.507640 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:18.508547 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.510669 (+ 2122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.513409 (+ 2740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.514895 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.515052 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.515312 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.515580 (+ 268us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.515738 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1078,"thread_start_us":925,"threads_started":1}
I20260923 19:45:18.516103 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.505508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:48946)
0923 19:45:18.506385 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.506433 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:18.506630 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:18.507675 (+ 1045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:18.507686 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:18.507722 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:18.508276 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.508294 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.510869 (+ 2575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.510876 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.513239 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.513264 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.515138 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.515145 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.515340 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.515398 (+ 58us) client_negotiation.cc:769] Sending connection context
0923 19:45:18.515534 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 19:45:18.515721 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":358,"threads_started":1}
I20260923 19:45:18.517921 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.507323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:35637 (local address 127.0.0.1:37258)
0923 19:45:18.508361 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.508383 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:18.509905 (+ 1522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:18.511153 (+ 1248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:18.511157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:18.511184 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:18.511622 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.511639 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.513506 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.513511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.515264 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.515277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.517126 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.517133 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.517312 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.517345 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 19:45:18.517423 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 19:45:18.517543 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"mutex_wait_us":84,"thread_start_us":664,"threads_started":1}
I20260923 19:45:18.518949 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.507816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37258 (local address 127.13.88.195:35637)
0923 19:45:18.510549 (+ 2733us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.510560 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.510605 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:45:18.510708 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.510716 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.510932 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.511178 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:18.511831 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.513383 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.515404 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.516881 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.518174 (+ 1293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.518394 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.518470 (+ 76us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.518627 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2568,"thread_start_us":2421,"threads_started":1}
I20260923 19:45:18.519521 29642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.506729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:41275 (local address 127.0.0.1:46024)
0923 19:45:18.507259 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.507277 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:18.507399 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:18.511489 (+ 4090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:18.511493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:18.511526 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:18.512043 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.512056 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.513853 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.513858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.516040 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.516072 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.518557 (+ 2485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.518562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.518738 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.518770 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:45:18.518865 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 19:45:18.519025 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":4,"thread_start_us":254,"threads_started":1}
I20260923 19:45:18.519788 29643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.507189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46024 (local address 127.13.88.194:41275)
0923 19:45:18.510817 (+ 3628us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.510825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.510847 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:45:18.510938 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.510944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.511204 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.511392 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:18.512243 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.513677 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.516641 (+ 2964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.518145 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.518240 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.518390 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.518946 (+ 556us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.519342 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3490,"thread_start_us":3393,"threads_started":1}
I20260923 19:45:18.520136 29295 tablet_service.cc:1467] Processing CreateTablet for tablet 6da2a13832fd4586b4ea67acec693354 (DEFAULT_TABLE table=test-table [id=cbc78a5de69a4b848dfcb094cbd0581f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:45:18.521720 29295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da2a13832fd4586b4ea67acec693354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:45:18.522629 29563 tablet_service.cc:1467] Processing CreateTablet for tablet 6da2a13832fd4586b4ea67acec693354 (DEFAULT_TABLE table=test-table [id=cbc78a5de69a4b848dfcb094cbd0581f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:45:18.523166 29429 tablet_service.cc:1467] Processing CreateTablet for tablet 6da2a13832fd4586b4ea67acec693354 (DEFAULT_TABLE table=test-table [id=cbc78a5de69a4b848dfcb094cbd0581f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:45:18.524129 29563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da2a13832fd4586b4ea67acec693354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:45:18.524533 29429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da2a13832fd4586b4ea67acec693354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:45:18.533870 29646 tablet_bootstrap.cc:492] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Bootstrap starting.
I20260923 19:45:18.537441 29646 tablet_bootstrap.cc:654] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Neither blocks nor log segments found. Creating new log.
I20260923 19:45:18.538712 29647 tablet_bootstrap.cc:492] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Bootstrap starting.
I20260923 19:45:18.538691 29646 log.cc:824] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:18.541296 29648 tablet_bootstrap.cc:492] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Bootstrap starting.
I20260923 19:45:18.543036 29647 tablet_bootstrap.cc:654] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Neither blocks nor log segments found. Creating new log.
I20260923 19:45:18.544776 29648 tablet_bootstrap.cc:654] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Neither blocks nor log segments found. Creating new log.
I20260923 19:45:18.544929 29646 tablet_bootstrap.cc:492] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: No bootstrap required, opened a new log
I20260923 19:45:18.544919 29647 log.cc:824] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:18.545207 29646 ts_tablet_manager.cc:1397] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260923 19:45:18.545995 29648 log.cc:824] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:18.547936 29647 tablet_bootstrap.cc:492] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: No bootstrap required, opened a new log
I20260923 19:45:18.548197 29647 ts_tablet_manager.cc:1397] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260923 19:45:18.548511 29648 tablet_bootstrap.cc:492] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: No bootstrap required, opened a new log
I20260923 19:45:18.548746 29648 ts_tablet_manager.cc:1397] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260923 19:45:18.555768 29646 raft_consensus.cc:348] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.556248 29646 raft_consensus.cc:374] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:45:18.556344 29646 raft_consensus.cc:729] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b90c5fa6b37485285f4074892796751, State: Initialized, Role: FOLLOWER
I20260923 19:45:18.556265 29648 raft_consensus.cc:348] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.556703 29648 raft_consensus.cc:374] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:45:18.556803 29648 raft_consensus.cc:729] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5829202cd2491cad8a0da7a4783192, State: Initialized, Role: FOLLOWER
I20260923 19:45:18.556967 29646 consensus_queue.cc:260] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.557456 29648 consensus_queue.cc:260] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.559057 29647 raft_consensus.cc:348] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.559506 29647 raft_consensus.cc:374] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:45:18.559628 29647 raft_consensus.cc:729] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9fa0dd730040149d80191b915a3aa9, State: Initialized, Role: FOLLOWER
I20260923 19:45:18.560343 29646 ts_tablet_manager.cc:1428] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260923 19:45:18.560714 29628 heartbeater.cc:503] Master 127.13.88.254:35983 was elected leader, sending a full tablet report...
I20260923 19:45:18.561318 29648 ts_tablet_manager.cc:1428] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260923 19:45:18.561950 29647 consensus_queue.cc:260] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.563266 29494 heartbeater.cc:503] Master 127.13.88.254:35983 was elected leader, sending a full tablet report...
I20260923 19:45:18.563933 29647 ts_tablet_manager.cc:1428] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Time spent starting tablet: real 0.016s user 0.012s sys 0.001s
I20260923 19:45:18.592667 29654 raft_consensus.cc:482] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:45:18.593020 29654 raft_consensus.cc:504] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.594731 29654 leader_election.cc:288] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281), 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637)
I20260923 19:45:18.603075 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.595138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:52963 (local address 127.13.88.193:40281)
0923 19:45:18.595330 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.595335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.595992 (+ 657us) server_negotiation.cc:407] Connection header received
0923 19:45:18.596229 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.596237 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.596329 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.596426 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:18.597144 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.598197 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.600721 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.601950 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.602108 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.602182 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.602689 (+ 507us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.602817 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 19:45:18.603071 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.596266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:52359 (local address 127.13.88.195:35637)
0923 19:45:18.596456 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.596461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.596676 (+ 215us) server_negotiation.cc:407] Connection header received
0923 19:45:18.596857 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.596860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.596914 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.596984 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:18.597488 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.598470 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.600721 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.601958 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.602108 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.602182 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.602689 (+ 507us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.602821 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:45:18.603569 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.595093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.13.88.194:52963)
0923 19:45:18.595883 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.595910 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:18.596046 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:18.596527 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:18.596532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:18.596559 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:18.597003 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.597017 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.598313 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.598316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.600560 (+ 2244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.600575 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.602214 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.602220 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.602502 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.602562 (+ 60us) client_negotiation.cc:769] Sending connection context
0923 19:45:18.602650 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 19:45:18.603096 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":102,"thread_start_us":423,"threads_started":1}
I20260923 19:45:18.603968 29656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.595995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:35637 (local address 127.13.88.194:52359)
0923 19:45:18.596578 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.596595 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:18.596729 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:18.597032 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:18.597036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:18.597065 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:18.597357 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.597363 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.598583 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.598588 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.600573 (+ 1985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:18.600581 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.602219 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.602223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:18.602487 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.602557 (+ 70us) client_negotiation.cc:769] Sending connection context
0923 19:45:18.602650 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 19:45:18.603567 (+ 917us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":761,"thread_start_us":318,"threads_started":1}
I20260923 19:45:18.604627 29315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da2a13832fd4586b4ea67acec693354" candidate_uuid: "9d9fa0dd730040149d80191b915a3aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b90c5fa6b37485285f4074892796751" is_pre_election: true
I20260923 19:45:18.605224 29315 raft_consensus.cc:2454] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d9fa0dd730040149d80191b915a3aa9 in term 0.
I20260923 19:45:18.605417 29583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da2a13832fd4586b4ea67acec693354" candidate_uuid: "9d9fa0dd730040149d80191b915a3aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5829202cd2491cad8a0da7a4783192" is_pre_election: true
I20260923 19:45:18.605950 29583 raft_consensus.cc:2454] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d9fa0dd730040149d80191b915a3aa9 in term 0.
I20260923 19:45:18.605990 29383 leader_election.cc:302] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b90c5fa6b37485285f4074892796751, 9d9fa0dd730040149d80191b915a3aa9; no voters:
I20260923 19:45:18.606353 29654 raft_consensus.cc:2781] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:45:18.606506 29654 raft_consensus.cc:482] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:45:18.606619 29654 raft_consensus.cc:3037] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:45:18.608819 29654 raft_consensus.cc:504] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.609409 29654 leader_election.cc:288] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [CANDIDATE]: Term 1 election: Requested vote from peers 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281), 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637)
I20260923 19:45:18.609866 29315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da2a13832fd4586b4ea67acec693354" candidate_uuid: "9d9fa0dd730040149d80191b915a3aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b90c5fa6b37485285f4074892796751"
I20260923 19:45:18.609866 29583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da2a13832fd4586b4ea67acec693354" candidate_uuid: "9d9fa0dd730040149d80191b915a3aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d5829202cd2491cad8a0da7a4783192"
I20260923 19:45:18.610071 29315 raft_consensus.cc:3037] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:45:18.610071 29583 raft_consensus.cc:3037] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:45:18.613258 29583 raft_consensus.cc:2454] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d9fa0dd730040149d80191b915a3aa9 in term 1.
I20260923 19:45:18.613268 29315 raft_consensus.cc:2454] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d9fa0dd730040149d80191b915a3aa9 in term 1.
I20260923 19:45:18.613656 29383 leader_election.cc:302] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5829202cd2491cad8a0da7a4783192, 9d9fa0dd730040149d80191b915a3aa9; no voters:
I20260923 19:45:18.613921 29654 raft_consensus.cc:2781] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:45:18.614359 29654 raft_consensus.cc:686] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 LEADER]: Becoming Leader. State: Replica: 9d9fa0dd730040149d80191b915a3aa9, State: Running, Role: LEADER
I20260923 19:45:18.614814 29654 consensus_queue.cc:237] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } }
I20260923 19:45:18.619275 29170 catalog_manager.cc:5495] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194). New cstate: current_term: 1 leader_uuid: "9d9fa0dd730040149d80191b915a3aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } health_report { overall_health: UNKNOWN } } }
I20260923 19:45:18.639856 29643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.634807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46036 (local address 127.13.88.194:41275)
0923 19:45:18.635021 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.635025 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.635083 (+ 58us) server_negotiation.cc:407] Connection header received
0923 19:45:18.635330 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.635334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.635476 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.635592 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:45:18.635882 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.636529 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.637855 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.638251 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.638338 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.638748 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:45:18.639290 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:45:18.639399 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.639471 (+ 72us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.639531 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:45:18.648084 29583 raft_consensus.cc:1261] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 1 FOLLOWER]: Refusing update from remote peer 9d9fa0dd730040149d80191b915a3aa9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:45:18.648084 29315 raft_consensus.cc:1261] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Refusing update from remote peer 9d9fa0dd730040149d80191b915a3aa9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:45:18.649098 29657 consensus_queue.cc:1035] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:45:18.649531 29654 consensus_queue.cc:1035] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:45:18.652957 29361 tablet.cc:2369] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:45:18.661191 29660 mvcc.cc:205] Tried to move back new op lower bound from 7332629375571681280 to 7332629375450497024. Current Snapshot: MvccSnapshot[applied={T|T < 7332629375571681280}]
I20260923 19:45:18.666314 29662 mvcc.cc:205] Tried to move back new op lower bound from 7332629375571681280 to 7332629375450497024. Current Snapshot: MvccSnapshot[applied={T|T < 7332629375571681280}]
I20260923 19:45:18.674748 29169 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:45:18.675042 29169 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:45:18.678683 29169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Sending DeleteTablet for 3 replicas of tablet 6da2a13832fd4586b4ea67acec693354
I20260923 19:45:18.679909 29295 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da2a13832fd4586b4ea67acec693354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:45:18 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:48946
I20260923 19:45:18.680238 29429 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da2a13832fd4586b4ea67acec693354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:45:18 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:46024
I20260923 19:45:18.680393 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 29232
I20260923 19:45:18.680857 29563 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da2a13832fd4586b4ea67acec693354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:45:18 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:37258
I20260923 19:45:18.693876 29672 tablet_replica.cc:330] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: stopping tablet replica
I20260923 19:45:18.694376 29672 raft_consensus.cc:2229] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:45:18.694921 29672 raft_consensus.cc:2258] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:45:18.696211 29670 tablet_replica.cc:330] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: stopping tablet replica
I20260923 19:45:18.696684 29670 raft_consensus.cc:2229] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:45:18.697402 29670 raft_consensus.cc:2258] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:45:18.697882 29672 ts_tablet_manager.cc:1905] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:45:18.699481 29670 ts_tablet_manager.cc:1905] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:45:18.700348 29669 tablet_replica.cc:330] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: stopping tablet replica
Sep 23 19:45:18 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:45:18.700749 29669 raft_consensus.cc:2229] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:45:18.704918 29672 ts_tablet_manager.cc:1918] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:45:18.705014 29669 raft_consensus.cc:2258] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:45:18.705072 29672 log.cc:1196] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/6da2a13832fd4586b4ea67acec693354
I20260923 19:45:18.705569 29672 ts_tablet_manager.cc:1939] T 6da2a13832fd4586b4ea67acec693354 P 5d5829202cd2491cad8a0da7a4783192: Deleting consensus metadata
I20260923 19:45:18.707422 29670 ts_tablet_manager.cc:1918] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:45:18.707418 29156 catalog_manager.cc:4841] TS 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637): tablet 6da2a13832fd4586b4ea67acec693354 (table test-table [id=cbc78a5de69a4b848dfcb094cbd0581f]) successfully deleted
I20260923 19:45:18.707690 29670 log.cc:1196] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/6da2a13832fd4586b4ea67acec693354
I20260923 19:45:18.708324 29670 ts_tablet_manager.cc:1939] T 6da2a13832fd4586b4ea67acec693354 P 9d9fa0dd730040149d80191b915a3aa9: Deleting consensus metadata
I20260923 19:45:18.708400 29669 ts_tablet_manager.cc:1905] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:45:18.710081 29156 catalog_manager.cc:4841] TS 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275): tablet 6da2a13832fd4586b4ea67acec693354 (table test-table [id=cbc78a5de69a4b848dfcb094cbd0581f]) successfully deleted
I20260923 19:45:18.714562 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.681525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48948 (local address 127.13.88.193:40281)
0923 19:45:18.681695 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.681701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.690730 (+ 9029us) server_negotiation.cc:407] Connection header received
0923 19:45:18.691241 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.691258 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.691352 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.691435 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:18.695668 (+ 4233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.696814 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.698796 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.699445 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.699547 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.707881 (+ 8334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:18.707899 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:18.707920 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:18.707981 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:18.711576 (+ 3595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.712324 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.712330 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.712333 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.712480 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.712875 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.712879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.712881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.713253 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:18.713577 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.713916 (+ 339us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.714149 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:45:18.715251 29355 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:18.808074 29669 ts_tablet_manager.cc:1918] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:45:18.808334 29669 log.cc:1196] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/6da2a13832fd4586b4ea67acec693354
I20260923 19:45:18.808758 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 29232
I20260923 19:45:18.808925 29669 ts_tablet_manager.cc:1939] T 6da2a13832fd4586b4ea67acec693354 P 8b90c5fa6b37485285f4074892796751: Deleting consensus metadata
W20260923 19:45:18.827126 29156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.88.193:40281 (error 108)
I20260923 19:45:18.827410 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 29366
I20260923 19:45:18.831075 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.830559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:48962)
0923 19:45:18.830759 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.830900 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260923 19:45:18.831435 29156 catalog_manager.cc:4584] TS 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6da2a13832fd4586b4ea67acec693354: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Sep 23 19:45:18 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:45:18.845486 29643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.828334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46048 (local address 127.13.88.194:41275)
0923 19:45:18.828514 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.828520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.828829 (+ 309us) server_negotiation.cc:407] Connection header received
0923 19:45:18.828906 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.828911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.829022 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.829135 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:18.830355 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.831655 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.833655 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.834178 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.834268 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.839494 (+ 5226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:18.839506 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:18.839521 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:18.839564 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:18.842575 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.843377 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.843384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.843387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.843521 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.843924 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.843932 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.843934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.844281 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:18.844614 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.844904 (+ 290us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.845119 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:45:18.846143 29489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:18.885106 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.884616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:48966)
0923 19:45:18.884841 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.884956 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260923 19:45:18.886214 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.885863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:48982)
0923 19:45:18.886022 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.886101 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 19:45:18.946848 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.946274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:48996)
0923 19:45:18.946590 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.946688 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
I20260923 19:45:18.947917 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.947594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:49006)
0923 19:45:18.947738 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:18.947811 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 19:45:18.959900 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 29366
I20260923 19:45:18.978374 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 29500
Sep 23 19:45:18 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192716, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:45:18.993037 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:18.979135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37264 (local address 127.13.88.195:35637)
0923 19:45:18.979280 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:18.979284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:18.979326 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:45:18.979470 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:18.979474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:18.979532 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:18.979613 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:18.980804 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.981521 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.982801 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:18.983367 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:18.983460 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:18.987769 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:18.987783 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:18.987799 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:18.987837 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:18.990594 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.991341 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.991349 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.991351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.991479 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:18.991811 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:18.991815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:18.991816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:18.992160 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:18.992368 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:18.992634 (+ 266us) server_negotiation.cc:299] Negotiation successful
0923 19:45:18.992798 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260923 19:45:18.993666 29623 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:19.028159 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:19.027704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:49008)
0923 19:45:19.027911 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:19.028021 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260923 19:45:19.029276 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:19.028841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:49020)
0923 19:45:19.029058 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:19.029127 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260923 19:45:19.082288 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 29500
I20260923 19:45:19.098528 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 29139
I20260923 19:45:19.099610 29201 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:19.211675 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 29139
I20260923 19:45:19.211712 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:19.210743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:49032)
0923 19:45:19.210935 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:19.211049 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260923 19:45:39.233269 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35983
--webserver_interface=127.13.88.254
--webserver_port=37469
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:35983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:45:39.561578 29678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:39.561858 29678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:39.561947 29678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:39.569331 29678 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 19:45:39.569435 29678 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 19:45:39.569474 29678 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 19:45:39.569520 29678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:45:39.569572 29678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:39.569640 29678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:39.569685 29678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:45:39.569738 29678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:45:39.579794 29678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:35983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=37469
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:39.581022 29678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:39.582319 29678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:39.605059 29687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:39.605080 29684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:39.605022 29685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:39.608556 29678 server_base.cc:1034] running on GCE node
I20260923 19:45:39.609438 29678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:39.611291 29678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:39.612517 29678 hybrid_clock.cc:648] HybridClock initialized: now 1790192739612446 us; error 44 us; skew 500 ppm
I20260923 19:45:39.612968 29678 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:39 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192739, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:39.621594 29678 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:45:39.623580 29678 webserver.cc:460] Webserver started at http://127.13.88.254:37469/ using document root <none> and password file <none>
I20260923 19:45:39.624409 29678 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:39.624518 29678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:39.630774 29678 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260923 19:45:39.633760 29694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:39.635278 29678 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:45:39.635427 29678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "596a86ffb523483889e1ce0313d682e5"
format_stamp: "Formatted at 2026-09-23 19:45:16 on dist-test-slave-xg7f"
server_key: "3ca7e0454830ab573656728e65fb6960"
server_key_iv: "6a8781077dd4b90ded169b07bcc47c5b"
server_key_version: "encryptionkey@0"
I20260923 19:45:39.636538 29678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:39.653375 29678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:39.657941 29678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:39.658197 29678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:39.687160 29678 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:35983
I20260923 19:45:39.687177 29745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:35983 every 8 connection(s)
I20260923 19:45:39.688901 29678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:45:39.692054 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 29678
I20260923 19:45:39.692910 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:40281
--local_ip_for_outbound_sockets=127.13.88.193
--tserver_master_addrs=127.13.88.254:35983
--webserver_port=43209
--webserver_interface=127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:45:39.696568 29746 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:45:39.700107 29746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Bootstrap starting.
I20260923 19:45:39.720109 29746 log.cc:824] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:39.732465 29746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:45:39.733026 29746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Bootstrap complete.
I20260923 19:45:39.742597 29746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:39.743532 29746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 596a86ffb523483889e1ce0313d682e5, State: Initialized, Role: FOLLOWER
I20260923 19:45:39.744133 29746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:39.744396 29746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:45:39.744529 29746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:45:39.744711 29746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:45:39.748598 29746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:39.749118 29746 leader_election.cc:302] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 596a86ffb523483889e1ce0313d682e5; no voters:
I20260923 19:45:39.749759 29746 leader_election.cc:288] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 19:45:39.749897 29750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:45:39.751183 29750 raft_consensus.cc:686] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 LEADER]: Becoming Leader. State: Replica: 596a86ffb523483889e1ce0313d682e5, State: Running, Role: LEADER
I20260923 19:45:39.751818 29750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:45:39.752171 29746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:45:39.754444 29751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "596a86ffb523483889e1ce0313d682e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } } }
I20260923 19:45:39.754870 29751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:45:39.756542 29752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 596a86ffb523483889e1ce0313d682e5. Latest consensus state: current_term: 2 leader_uuid: "596a86ffb523483889e1ce0313d682e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } } }
I20260923 19:45:39.756899 29752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:45:39.758249 29755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:45:39.767858 29755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:45:39.769443 29755 catalog_manager.cc:1259] Loaded cluster ID: 64f38519eb89481dba42b7f71f27a693
I20260923 19:45:39.769596 29755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:45:39.773734 29755 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:45:39.775413 29755 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Loaded TSK: 0
I20260923 19:45:39.809775 29755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Generated new TSK 1
I20260923 19:45:39.810205 29755 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 19:45:40.079955 29748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:40.080308 29748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:40.080473 29748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:40.087787 29748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:40.087934 29748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:40.088102 29748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:45:40.097774 29748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:40281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=43209
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:40.099071 29748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:40.100419 29748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:40.119513 29774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:40.120641 29773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:40.121098 29776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:40.123212 29748 server_base.cc:1034] running on GCE node
I20260923 19:45:40.124178 29748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:40.125613 29748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:40.126816 29748 hybrid_clock.cc:648] HybridClock initialized: now 1790192740126743 us; error 61 us; skew 500 ppm
I20260923 19:45:40.127264 29748 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:40 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192740, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:40.131316 29748 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:45:40.139510 29748 webserver.cc:460] Webserver started at http://127.13.88.193:43209/ using document root <none> and password file <none>
I20260923 19:45:40.140513 29748 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:40.140690 29748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:40.149044 29748 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:45:40.153047 29783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:40.155026 29748 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:45:40.155264 29748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "8b90c5fa6b37485285f4074892796751"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "425326d12b3d876d78ceb93d6b2ac929"
server_key_iv: "49a03076ac6052bd8851b93e1dc70344"
server_key_version: "encryptionkey@0"
I20260923 19:45:40.156862 29748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:40.177037 29748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:40.181236 29748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:40.181509 29748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:40.182590 29748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:45:40.184044 29748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:45:40.184172 29748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:40.184306 29748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:45:40.184392 29748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:40.218701 29748 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:40281
I20260923 19:45:40.218770 29895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:40281 every 8 connection(s)
I20260923 19:45:40.220214 29748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:45:40.229031 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 29748
I20260923 19:45:40.229678 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:41275
--local_ip_for_outbound_sockets=127.13.88.194
--tserver_master_addrs=127.13.88.254:35983
--webserver_port=34349
--webserver_interface=127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:45:40 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192740, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:45:40.246362 29898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:40.223031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:39221 (local address 127.13.88.254:35983)
0923 19:45:40.223572 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:40.223583 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:40.224259 (+ 676us) server_negotiation.cc:407] Connection header received
0923 19:45:40.226419 (+ 2160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:40.226432 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:40.226779 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:40.227152 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:40.228780 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.230215 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.232802 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.233435 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.233585 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:40.238206 (+ 4621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:40.238214 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:40.238230 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:40.238270 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:40.241667 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:40.242447 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:40.242455 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:40.242461 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:40.242624 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:40.243081 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:40.243091 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:40.243093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:40.243627 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:40.243850 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:40.244635 (+ 785us) server_negotiation.cc:299] Negotiation successful
0923 19:45:40.245011 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":232,"threads_started":1}
I20260923 19:45:40.246361 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:40.223356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:39221)
0923 19:45:40.224065 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:40.224103 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:40.225874 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:40.227328 (+ 1454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:40.227341 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:40.227955 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:40.228526 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:40.228552 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.230403 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.230411 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:40.232629 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:40.232647 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.233675 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.233692 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:40.234011 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:40.234762 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:40.234797 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:40.237892 (+ 3095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:40.241819 (+ 3927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:40.241828 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:40.241845 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:40.242289 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:40.242752 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:40.242757 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:40.242761 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:40.242951 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:40.243776 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:40.243784 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:40.244137 (+ 353us) client_negotiation.cc:769] Sending connection context
0923 19:45:40.244408 (+ 271us) client_negotiation.cc:240] Negotiation successful
0923 19:45:40.244998 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":275,"threads_started":1}
I20260923 19:45:40.249428 29896 heartbeater.cc:347] Connected to a master server at 127.13.88.254:35983
I20260923 19:45:40.249759 29896 heartbeater.cc:464] Registering TS with master...
I20260923 19:45:40.250489 29896 heartbeater.cc:511] Master 127.13.88.254:35983 requested a full tablet report, sending...
I20260923 19:45:40.252800 29711 ts_manager.cc:194] Registered new tserver with Master: 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281)
I20260923 19:45:40.254385 29711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:39221
W20260923 19:45:40.561233 29900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:40.561565 29900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:40.561729 29900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:40.569159 29900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:40.569316 29900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:40.569494 29900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:45:40.579552 29900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:41275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=34349
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:40.580912 29900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:40.582275 29900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:40.595763 29905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:40.595721 29906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:40.595784 29908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:40.596737 29900 server_base.cc:1034] running on GCE node
I20260923 19:45:40.597329 29900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:40.598248 29900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:40.599465 29900 hybrid_clock.cc:648] HybridClock initialized: now 1790192740599426 us; error 56 us; skew 500 ppm
I20260923 19:45:40.599803 29900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:40 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192740, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:40.602855 29900 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:45:40.604409 29900 webserver.cc:460] Webserver started at http://127.13.88.194:34349/ using document root <none> and password file <none>
I20260923 19:45:40.605108 29900 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:40.605217 29900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:40.610616 29900 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:45:40.613288 29915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:40.614637 29900 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:45:40.614784 29900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "9d9fa0dd730040149d80191b915a3aa9"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "e77134945acbdcc110bbee409d2e65b4"
server_key_iv: "e68bf69058b57716d477b41742f2d241"
server_key_version: "encryptionkey@0"
I20260923 19:45:40.615753 29900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:40.659715 29900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:40.664204 29900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:40.664434 29900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:40.665378 29900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:45:40.666759 29900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:45:40.666846 29900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:40.666923 29900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:45:40.666977 29900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:40.704473 29900 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:41275
I20260923 19:45:40.704520 30027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:41275 every 8 connection(s)
I20260923 19:45:40.706262 29900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:45:40.716506 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 29900
I20260923 19:45:40.717290 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:35637
--local_ip_for_outbound_sockets=127.13.88.195
--tserver_master_addrs=127.13.88.254:35983
--webserver_port=35719
--webserver_interface=127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 19:45:40 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192740, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:45:40.726421 29898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:40.708973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:60301 (local address 127.13.88.254:35983)
0923 19:45:40.709187 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:40.709193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:40.710388 (+ 1195us) server_negotiation.cc:407] Connection header received
0923 19:45:40.712240 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:40.712244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:40.712334 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:40.712421 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:40.713841 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.714521 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.716080 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.716488 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.716588 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:40.720863 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:40.720868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:40.720871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:40.720903 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:40.723445 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:40.724177 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:40.724183 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:40.724191 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:40.724307 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:40.724728 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:40.724733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:40.724736 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:40.725031 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:40.725181 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:40.725849 (+ 668us) server_negotiation.cc:299] Negotiation successful
0923 19:45:40.726087 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 19:45:40.727651 30030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:40.709502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:60301)
0923 19:45:40.710214 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:40.710257 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:40.711988 (+ 1731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:40.712630 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:40.712637 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:40.713144 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:40.713696 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:40.713713 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.714681 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.714684 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:40.715954 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:40.715970 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:40.716725 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:40.716732 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:40.717025 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:40.717787 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:40.717820 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:40.720628 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:40.723612 (+ 2984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:40.723621 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:40.723638 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:40.724052 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:40.724413 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:40.724419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:40.724423 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:40.724611 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:40.725153 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:40.725161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:40.725498 (+ 337us) client_negotiation.cc:769] Sending connection context
0923 19:45:40.725759 (+ 261us) client_negotiation.cc:240] Negotiation successful
0923 19:45:40.726298 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":272,"threads_started":1}
I20260923 19:45:40.729295 30028 heartbeater.cc:347] Connected to a master server at 127.13.88.254:35983
I20260923 19:45:40.729652 30028 heartbeater.cc:464] Registering TS with master...
I20260923 19:45:40.730517 30028 heartbeater.cc:511] Master 127.13.88.254:35983 requested a full tablet report, sending...
I20260923 19:45:40.732169 29711 ts_manager.cc:194] Registered new tserver with Master: 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
I20260923 19:45:40.732976 29711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:60301
W20260923 19:45:41.047721 30031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:45:41.047986 30031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:45:41.048139 30031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:45:41.055313 30031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:45:41.055457 30031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:45:41.055655 30031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:45:41.065997 30031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:35637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=35719
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:45:41.067438 30031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:45:41.068840 30031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:45:41.081866 30039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:41.081943 30037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:45:41.082165 30036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:45:41.082736 30031 server_base.cc:1034] running on GCE node
I20260923 19:45:41.083513 30031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:45:41.084507 30031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:45:41.085734 30031 hybrid_clock.cc:648] HybridClock initialized: now 1790192741085684 us; error 48 us; skew 500 ppm
I20260923 19:45:41.086063 30031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:45:41 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192741, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:45:41.089300 30031 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:45:41.090788 30031 webserver.cc:460] Webserver started at http://127.13.88.195:35719/ using document root <none> and password file <none>
I20260923 19:45:41.091591 30031 fs_manager.cc:359] Metadata directory not provided
I20260923 19:45:41.091751 30031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:45:41.097015 30031 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 19:45:41.099653 30046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:41.100930 30031 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:45:41.101095 30031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "5d5829202cd2491cad8a0da7a4783192"
format_stamp: "Formatted at 2026-09-23 19:45:18 on dist-test-slave-xg7f"
server_key: "af5d98242c9f2c6912417bba16719a6b"
server_key_iv: "b45c934dc03223636c8b972f9b8df773"
server_key_version: "encryptionkey@0"
I20260923 19:45:41.102044 30031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:45:41.121708 30031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:45:41.126116 30031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:45:41.126405 30031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:45:41.127454 30031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:45:41.128809 30031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:45:41.128935 30031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:41.129070 30031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:45:41.129156 30031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:45:41.161655 30031 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:35637
I20260923 19:45:41.161717 30158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:35637 every 8 connection(s)
I20260923 19:45:41.163333 30031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:45:41.163652 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 30031
Sep 23 19:45:41 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192741, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:45:41.180919 29898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.165276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43002 (local address 127.13.88.254:35983)
0923 19:45:41.165470 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.165476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.165499 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:45:41.165637 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.165645 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.165748 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.165864 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:41.168027 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.168744 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.170813 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.171377 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.171505 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.174686 (+ 3181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:41.174691 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:41.174694 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:41.174725 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:41.177932 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.178708 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.178711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.178714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.178830 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.179268 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.179274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.179278 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.179579 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:41.179873 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.180258 (+ 385us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.180478 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:45:41.186837 30162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.166334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:34339 (local address 127.13.88.254:35983)
0923 19:45:41.166811 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.166817 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.167977 (+ 1160us) server_negotiation.cc:407] Connection header received
0923 19:45:41.171395 (+ 3418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.171400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.171480 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.171575 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:41.173679 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.174387 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.176034 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.176800 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.176937 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.180510 (+ 3573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:41.180514 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:41.180517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:41.180545 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:41.183861 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.184574 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.184580 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.184583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.184705 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.185121 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.185126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.185130 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.185398 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:41.185546 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.186227 (+ 681us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.186444 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":248,"threads_started":1}
I20260923 19:45:41.187853 30163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.166923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:34339)
0923 19:45:41.167781 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.167838 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:41.171166 (+ 3328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:41.171864 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:41.171876 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:41.172618 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:45:41.173491 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.173521 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.174552 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.174558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.175889 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.175901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.177007 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.177012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.177220 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.177807 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:45:41.177828 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:45:41.180285 (+ 2457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:45:41.183994 (+ 3709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:41.184003 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:41.184021 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:41.184448 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:41.184813 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:45:41.184817 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:45:41.184821 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:45:41.185005 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:45:41.185531 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:45:41.185539 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:45:41.185884 (+ 345us) client_negotiation.cc:769] Sending connection context
0923 19:45:41.186145 (+ 261us) client_negotiation.cc:240] Negotiation successful
0923 19:45:41.186677 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":342,"threads_started":1}
I20260923 19:45:41.189144 30159 heartbeater.cc:347] Connected to a master server at 127.13.88.254:35983
I20260923 19:45:41.189477 30159 heartbeater.cc:464] Registering TS with master...
I20260923 19:45:41.190205 30159 heartbeater.cc:511] Master 127.13.88.254:35983 requested a full tablet report, sending...
I20260923 19:45:41.191672 29711 ts_manager.cc:194] Registered new tserver with Master: 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637)
I20260923 19:45:41.192442 29711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:34339
I20260923 19:45:41.196022 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:45:41.202385 30162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.196886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43016 (local address 127.13.88.254:35983)
0923 19:45:41.197045 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.197050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.197571 (+ 521us) server_negotiation.cc:407] Connection header received
0923 19:45:41.197742 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.197745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.197884 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.197997 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:45:41.198370 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.199058 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.200760 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.201159 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.201268 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.201692 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:45:41.201888 (+ 196us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0923 19:45:41.202158 (+ 270us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43016: token expired
Metrics: {"server-negotiator.queue_time_us":60}
W20260923 19:45:41.202509 30162 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43016: token expired
W20260923 19:45:41.203047 29634 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.13.88.254:35983)
I20260923 19:45:41.215864 30162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.203523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.13.88.254:35983)
0923 19:45:41.203691 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.203697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.203761 (+ 64us) server_negotiation.cc:407] Connection header received
0923 19:45:41.203932 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.203937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.204001 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.204102 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:41.205482 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.206180 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.207705 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.208117 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.208256 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.210805 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:41.210810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:41.210813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:41.210843 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:41.213182 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.213870 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.213877 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.213880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.214000 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.214373 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.214379 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.214383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.214690 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:41.214960 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.215291 (+ 331us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.215507 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 19:45:41.219554 29711 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:45:41.229106 29711 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:45:41.252635 30171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.241798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:37804)
0923 19:45:41.242625 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.242641 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:41.242756 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:41.244082 (+ 1326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:41.244090 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:41.244125 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:41.245187 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.245201 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.247182 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.247187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.249952 (+ 2765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.249969 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.251433 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.251439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.251645 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.251702 (+ 57us) client_negotiation.cc:769] Sending connection context
0923 19:45:41.251844 (+ 142us) client_negotiation.cc:240] Negotiation successful
0923 19:45:41.252034 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"mutex_wait_us":68,"thread_start_us":562,"threads_started":1}
I20260923 19:45:41.252990 30172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.242129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37804 (local address 127.13.88.193:40281)
0923 19:45:41.243374 (+ 1245us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.243387 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.243421 (+ 34us) server_negotiation.cc:407] Connection header received
0923 19:45:41.243531 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.243542 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.243832 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.244371 (+ 539us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:41.245534 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.246993 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.250129 (+ 3136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.251215 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.251363 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.251608 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.251902 (+ 294us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.252684 (+ 782us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1034,"thread_start_us":1214,"threads_started":1}
I20260923 19:45:41.253362 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.240761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60284 (local address 127.13.88.195:35637)
0923 19:45:41.242313 (+ 1552us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.242324 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.242363 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:45:41.242484 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.242495 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.242802 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.243007 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:41.245578 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.246961 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.250197 (+ 3236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.251723 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.251848 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.252069 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.252783 (+ 714us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.252946 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1350,"thread_start_us":1175,"threads_started":1}
I20260923 19:45:41.254141 30169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.240339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:35637 (local address 127.0.0.1:60284)
0923 19:45:41.241249 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.241308 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:41.241476 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:41.243350 (+ 1874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:41.243360 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:41.243392 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:41.245405 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.245415 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.247094 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.247118 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.250076 (+ 2958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.250087 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.252302 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.252312 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.252569 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.252608 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:45:41.253618 (+ 1010us) client_negotiation.cc:240] Negotiation successful
0923 19:45:41.253762 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"mutex_wait_us":88,"thread_start_us":497,"threads_started":1}
I20260923 19:45:41.254434 30173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.242696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:41275 (local address 127.0.0.1:34652)
0923 19:45:41.245519 (+ 2823us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.245536 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:41.245639 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:41.246223 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:41.246228 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:41.246251 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:41.246549 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.246560 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.248300 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.248305 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.250084 (+ 1779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.250101 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.253506 (+ 3405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.253518 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.253689 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.253721 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 19:45:41.253829 (+ 108us) client_negotiation.cc:240] Negotiation successful
0923 19:45:41.253964 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2694,"mutex_wait_us":28,"thread_start_us":2330,"threads_started":1}
I20260923 19:45:41.255523 30174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.243165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.13.88.194:41275)
0923 19:45:41.244814 (+ 1649us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.244820 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.245612 (+ 792us) server_negotiation.cc:407] Connection header received
0923 19:45:41.245802 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.245810 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.246024 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.246206 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:41.246728 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.248117 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.250311 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.251715 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.251865 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.252031 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.253882 (+ 1851us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.254047 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1507,"thread_start_us":1404,"threads_started":1}
I20260923 19:45:41.257133 29831 tablet_service.cc:1467] Processing CreateTablet for tablet 293a0bc5bfa44b39ae04691353c72e46 (DEFAULT_TABLE table=test-table [id=ed7e585f42d744db8aa01e6cd8fa6a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:45:41.257748 29896 heartbeater.cc:503] Master 127.13.88.254:35983 was elected leader, sending a full tablet report...
I20260923 19:45:41.257567 30094 tablet_service.cc:1467] Processing CreateTablet for tablet 293a0bc5bfa44b39ae04691353c72e46 (DEFAULT_TABLE table=test-table [id=ed7e585f42d744db8aa01e6cd8fa6a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:45:41.258920 29831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293a0bc5bfa44b39ae04691353c72e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:45:41.259671 30094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293a0bc5bfa44b39ae04691353c72e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:45:41.263149 29963 tablet_service.cc:1467] Processing CreateTablet for tablet 293a0bc5bfa44b39ae04691353c72e46 (DEFAULT_TABLE table=test-table [id=ed7e585f42d744db8aa01e6cd8fa6a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:45:41.264957 29963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 293a0bc5bfa44b39ae04691353c72e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:45:41.277755 30175 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Bootstrap starting.
I20260923 19:45:41.282197 30175 tablet_bootstrap.cc:654] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Neither blocks nor log segments found. Creating new log.
I20260923 19:45:41.283026 30177 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Bootstrap starting.
I20260923 19:45:41.283842 30175 log.cc:824] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:41.285562 30176 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Bootstrap starting.
I20260923 19:45:41.286386 30177 tablet_bootstrap.cc:654] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Neither blocks nor log segments found. Creating new log.
I20260923 19:45:41.287468 30177 log.cc:824] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:41.287736 30175 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: No bootstrap required, opened a new log
I20260923 19:45:41.288015 30175 ts_tablet_manager.cc:1397] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260923 19:45:41.289112 30176 tablet_bootstrap.cc:654] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Neither blocks nor log segments found. Creating new log.
I20260923 19:45:41.290311 30176 log.cc:824] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Log is configured to *not* fsync() on all Append() calls
I20260923 19:45:41.293453 30176 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: No bootstrap required, opened a new log
I20260923 19:45:41.293725 30176 ts_tablet_manager.cc:1397] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260923 19:45:41.294064 30177 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: No bootstrap required, opened a new log
I20260923 19:45:41.294332 30177 ts_tablet_manager.cc:1397] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260923 19:45:41.296936 30175 raft_consensus.cc:348] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.297312 30175 raft_consensus.cc:374] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:45:41.297442 30175 raft_consensus.cc:729] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5829202cd2491cad8a0da7a4783192, State: Initialized, Role: FOLLOWER
I20260923 19:45:41.298028 30175 consensus_queue.cc:260] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.299222 30159 heartbeater.cc:503] Master 127.13.88.254:35983 was elected leader, sending a full tablet report...
I20260923 19:45:41.299821 30175 ts_tablet_manager.cc:1428] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260923 19:45:41.304281 30176 raft_consensus.cc:348] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.304733 30176 raft_consensus.cc:374] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:45:41.304828 30176 raft_consensus.cc:729] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b90c5fa6b37485285f4074892796751, State: Initialized, Role: FOLLOWER
I20260923 19:45:41.304613 30177 raft_consensus.cc:348] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.305037 30177 raft_consensus.cc:374] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:45:41.305135 30177 raft_consensus.cc:729] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9fa0dd730040149d80191b915a3aa9, State: Initialized, Role: FOLLOWER
I20260923 19:45:41.305485 30176 consensus_queue.cc:260] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.305769 30177 consensus_queue.cc:260] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.307963 30176 ts_tablet_manager.cc:1428] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260923 19:45:41.308876 30177 ts_tablet_manager.cc:1428] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Time spent starting tablet: real 0.014s user 0.007s sys 0.008s
I20260923 19:45:41.309275 30028 heartbeater.cc:503] Master 127.13.88.254:35983 was elected leader, sending a full tablet report...
W20260923 19:45:41.415021 30160 tablet.cc:2369] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:45:41.458663 30029 tablet.cc:2369] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:45:41.472452 29897 tablet.cc:2369] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:45:41.497617 30181 raft_consensus.cc:482] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:45:41.497962 30181 raft_consensus.cc:504] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.499684 30181 leader_election.cc:288] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281), 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
I20260923 19:45:41.505313 30172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.500198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:50989 (local address 127.13.88.193:40281)
0923 19:45:41.500433 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.500440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.500463 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:45:41.500547 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.500555 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.500655 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.500793 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:41.501350 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.502079 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.503736 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.504479 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.504642 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.504724 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.504962 (+ 238us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.505086 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260923 19:45:41.505369 30163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.499992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.13.88.195:50989)
0923 19:45:41.500217 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.500238 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:41.500364 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:41.500955 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:41.500959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:41.500981 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:41.501188 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.501196 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.502228 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.502234 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.503572 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.503583 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.504626 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.504631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.504805 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.504828 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 19:45:41.504926 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 19:45:41.505073 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260923 19:45:41.506330 30184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.500369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:41275 (local address 127.13.88.195:40375)
0923 19:45:41.501038 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.501050 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 19:45:41.501223 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:45:41.501526 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:45:41.501530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:45:41.501552 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:45:41.501869 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.501876 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.502790 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.502795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.504303 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:45:41.504315 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.505636 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.505645 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:45:41.505790 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.505812 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:45:41.505899 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 19:45:41.505979 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":364,"threads_started":1}
I20260923 19:45:41.506383 30174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.500733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:40375 (local address 127.13.88.194:41275)
0923 19:45:41.500937 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.500943 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.501159 (+ 216us) server_negotiation.cc:407] Connection header received
0923 19:45:41.501350 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.501360 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.501416 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.501509 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:45:41.502005 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.502651 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.504492 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.505330 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.505523 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.505584 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.505948 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.506100 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 19:45:41.506577 29851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a0bc5bfa44b39ae04691353c72e46" candidate_uuid: "5d5829202cd2491cad8a0da7a4783192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b90c5fa6b37485285f4074892796751" is_pre_election: true
I20260923 19:45:41.507208 29851 raft_consensus.cc:2454] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5829202cd2491cad8a0da7a4783192 in term 0.
I20260923 19:45:41.507369 29983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a0bc5bfa44b39ae04691353c72e46" candidate_uuid: "5d5829202cd2491cad8a0da7a4783192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d9fa0dd730040149d80191b915a3aa9" is_pre_election: true
I20260923 19:45:41.507905 29983 raft_consensus.cc:2454] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d5829202cd2491cad8a0da7a4783192 in term 0.
I20260923 19:45:41.507937 30048 leader_election.cc:302] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5829202cd2491cad8a0da7a4783192, 8b90c5fa6b37485285f4074892796751; no voters:
I20260923 19:45:41.508332 30181 raft_consensus.cc:2781] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:45:41.508481 30181 raft_consensus.cc:482] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:45:41.508599 30181 raft_consensus.cc:3037] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:45:41.510802 30181 raft_consensus.cc:504] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.511474 30181 leader_election.cc:288] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [CANDIDATE]: Term 1 election: Requested vote from peers 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281), 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
I20260923 19:45:41.511814 29851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a0bc5bfa44b39ae04691353c72e46" candidate_uuid: "5d5829202cd2491cad8a0da7a4783192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b90c5fa6b37485285f4074892796751"
I20260923 19:45:41.511895 29983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "293a0bc5bfa44b39ae04691353c72e46" candidate_uuid: "5d5829202cd2491cad8a0da7a4783192" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d9fa0dd730040149d80191b915a3aa9"
I20260923 19:45:41.512004 29851 raft_consensus.cc:3037] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:45:41.512092 29983 raft_consensus.cc:3037] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:45:41.514122 29851 raft_consensus.cc:2454] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5829202cd2491cad8a0da7a4783192 in term 1.
I20260923 19:45:41.514315 29983 raft_consensus.cc:2454] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d5829202cd2491cad8a0da7a4783192 in term 1.
I20260923 19:45:41.514508 30048 leader_election.cc:302] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5829202cd2491cad8a0da7a4783192, 8b90c5fa6b37485285f4074892796751; no voters:
I20260923 19:45:41.514789 30181 raft_consensus.cc:2781] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:45:41.515267 30181 raft_consensus.cc:686] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 1 LEADER]: Becoming Leader. State: Replica: 5d5829202cd2491cad8a0da7a4783192, State: Running, Role: LEADER
I20260923 19:45:41.515715 30181 consensus_queue.cc:237] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:45:41.520093 29710 catalog_manager.cc:5495] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "5d5829202cd2491cad8a0da7a4783192" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260923 19:45:41.548712 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.543327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39580 (local address 127.13.88.195:35637)
0923 19:45:41.543533 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.543541 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.543559 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:45:41.543804 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.543808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.543884 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.544031 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:45:41.544413 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.545144 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.546553 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.546962 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.547088 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.547629 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:45:41.548142 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:45:41.548329 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.548379 (+ 50us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.548453 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:45:41.557006 29983 raft_consensus.cc:1261] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 FOLLOWER]: Refusing update from remote peer 5d5829202cd2491cad8a0da7a4783192: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:45:41.557006 29851 raft_consensus.cc:1261] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Refusing update from remote peer 5d5829202cd2491cad8a0da7a4783192: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:45:41.557960 30181 consensus_queue.cc:1035] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:45:41.558256 30185 consensus_queue.cc:1035] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:45:41.571614 30189 mvcc.cc:205] Tried to move back new op lower bound from 7332629469407125504 to 7332629469251588096. Current Snapshot: MvccSnapshot[applied={T|T < 7332629469407125504}]
I20260923 19:45:41.572928 30188 mvcc.cc:205] Tried to move back new op lower bound from 7332629469407125504 to 7332629469251588096. Current Snapshot: MvccSnapshot[applied={T|T < 7332629469407125504}]
I20260923 19:45:41.585808 29710 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:45:41.586091 29710 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:45:41.589493 29710 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Sending DeleteTablet for 3 replicas of tablet 293a0bc5bfa44b39ae04691353c72e46
I20260923 19:45:41.590528 30094 tablet_service.cc:1514] Processing DeleteTablet for tablet 293a0bc5bfa44b39ae04691353c72e46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:45:41 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:60284
I20260923 19:45:41.590768 29831 tablet_service.cc:1514] Processing DeleteTablet for tablet 293a0bc5bfa44b39ae04691353c72e46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:45:41 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:37804
I20260923 19:45:41.590885 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 29748
I20260923 19:45:41.591773 29963 tablet_service.cc:1514] Processing DeleteTablet for tablet 293a0bc5bfa44b39ae04691353c72e46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:45:41 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:34652
I20260923 19:45:41.599576 30197 tablet_replica.cc:330] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: stopping tablet replica
I20260923 19:45:41.600123 30197 raft_consensus.cc:2229] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:45:41.600888 30197 raft_consensus.cc:2258] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:45:41.603647 30197 ts_tablet_manager.cc:1905] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:45:41.604964 30199 tablet_replica.cc:330] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: stopping tablet replica
I20260923 19:45:41.605559 30199 raft_consensus.cc:2229] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:45:41.606170 30199 raft_consensus.cc:2258] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:45:41.608510 30199 ts_tablet_manager.cc:1905] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:45:41.615621 30198 tablet_replica.cc:330] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: stopping tablet replica
I20260923 19:45:41.616036 30172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.592655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43418 (local address 127.13.88.193:40281)
0923 19:45:41.592889 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.592897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.592919 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:45:41.592991 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.592999 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.593096 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.593247 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:41.595734 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.597341 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.599918 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.600858 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.601005 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.605587 (+ 4582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:41.605609 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:41.605634 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:41.605686 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:41.610821 (+ 5135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.612031 (+ 1210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.612044 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.612050 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.612288 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.612821 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.612828 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.612834 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.613436 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:41.613805 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.615368 (+ 1563us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.615564 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:45:41.616400 30198 raft_consensus.cc:2229] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:45:41.616762 29891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:41.617497 30199 ts_tablet_manager.cc:1918] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:45:41.617748 30199 log.cc:1196] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/293a0bc5bfa44b39ae04691353c72e46
I20260923 19:45:41.618369 30199 ts_tablet_manager.cc:1939] T 293a0bc5bfa44b39ae04691353c72e46 P 9d9fa0dd730040149d80191b915a3aa9: Deleting consensus metadata
I20260923 19:45:41.620519 29696 catalog_manager.cc:4841] TS 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275): tablet 293a0bc5bfa44b39ae04691353c72e46 (table test-table [id=ed7e585f42d744db8aa01e6cd8fa6a5c]) successfully deleted
I20260923 19:45:41.623850 30197 ts_tablet_manager.cc:1918] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:45:41.624068 30197 log.cc:1196] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/293a0bc5bfa44b39ae04691353c72e46
I20260923 19:45:41.624743 30197 ts_tablet_manager.cc:1939] T 293a0bc5bfa44b39ae04691353c72e46 P 5d5829202cd2491cad8a0da7a4783192: Deleting consensus metadata
I20260923 19:45:41.626971 29696 catalog_manager.cc:4841] TS 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637): tablet 293a0bc5bfa44b39ae04691353c72e46 (table test-table [id=ed7e585f42d744db8aa01e6cd8fa6a5c]) successfully deleted
I20260923 19:45:41.765434 30198 raft_consensus.cc:2258] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:45:41.766213 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 29748
I20260923 19:45:41.783871 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 29900
W20260923 19:45:41.783913 29696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.88.193:40281 (error 108)
I20260923 19:45:41.786348 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.785541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:43432)
0923 19:45:41.785981 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.786115 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":210,"threads_started":1}
W20260923 19:45:41.786644 29696 catalog_manager.cc:4584] TS 8b90c5fa6b37485285f4074892796751 (127.13.88.193:40281): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 293a0bc5bfa44b39ae04691353c72e46: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
I20260923 19:45:41.802238 30174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.785081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49102 (local address 127.13.88.194:41275)
0923 19:45:41.785270 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.785274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.785291 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:45:41.785345 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.785350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.785409 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.785526 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:41.787326 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.788057 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.789373 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.789754 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.789886 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.796438 (+ 6552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:41.796453 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:41.796468 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:41.796505 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:41.799459 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.800130 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.800145 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.800147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.800275 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.800634 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.800642 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.800645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.801028 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:41.801340 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.801666 (+ 326us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.801884 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:45:41.802933 30023 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:41.840410 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.839792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:43440)
0923 19:45:41.840099 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.840216 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260923 19:45:41.841686 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.841271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:43452)
0923 19:45:41.841433 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.841538 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:45:41.896170 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 29900
I20260923 19:45:41.902067 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.901639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:43462)
0923 19:45:41.901841 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.901924 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260923 19:45:41.903183 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.902784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:43468)
0923 19:45:41.902922 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.902991 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260923 19:45:41.919629 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 30031
I20260923 19:45:41.933743 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.920542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39590 (local address 127.13.88.195:35637)
0923 19:45:41.920772 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0923 19:45:41.920779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:45:41.920799 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:45:41.920867 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:45:41.920871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:45:41.920936 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:45:41.921042 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:45:41.922359 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.923286 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.924596 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:45:41.925049 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:45:41.925183 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:45:41.927812 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:45:41.927826 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:45:41.927845 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:45:41.927883 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:45:41.930816 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.931621 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.931637 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.931639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.931793 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:45:41.932188 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:45:41.932195 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:45:41.932199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:45:41.932550 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:45:41.932870 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0923 19:45:41.933174 (+ 304us) server_negotiation.cc:299] Negotiation successful
0923 19:45:41.933389 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:45:41.934499 30154 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:41.983613 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.983124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:43484)
0923 19:45:41.983367 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.983458 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260923 19:45:41.984701 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:45:41.984317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40281 (local address 127.0.0.1:43490)
0923 19:45:41.984502 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0923 19:45:41.984572 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:40281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260923 19:45:42.060760 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 30031
I20260923 19:45:42.080372 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 29678
I20260923 19:45:42.081514 29741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:45:42.195935 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 29678
I20260923 19:46:02.218298 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35983
--webserver_interface=127.13.88.254
--webserver_port=37469
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:35983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:02.548983 30206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:02.549283 30206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:02.549430 30206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:02.556588 30206 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 19:46:02.556682 30206 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 19:46:02.556770 30206 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 19:46:02.556843 30206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:02.556928 30206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:02.557044 30206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:02.557142 30206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:02.557224 30206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:02.567492 30206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:35983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:35983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=37469
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:02.568815 30206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:02.570175 30206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:02.582175 30212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:02.582139 30214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:02.582217 30211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:02.583200 30206 server_base.cc:1034] running on GCE node
I20260923 19:46:02.583968 30206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:02.585279 30206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:02.586506 30206 hybrid_clock.cc:648] HybridClock initialized: now 1790192762586457 us; error 31 us; skew 500 ppm
I20260923 19:46:02.586848 30206 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:02 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192762, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:02.589990 30206 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:46:02.591506 30206 webserver.cc:460] Webserver started at http://127.13.88.254:37469/ using document root <none> and password file <none>
I20260923 19:46:02.592200 30206 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:02.592321 30206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:02.597553 30206 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 19:46:02.600400 30221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:02.601656 30206 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:02.601830 30206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "596a86ffb523483889e1ce0313d682e5"
format_stamp: "Formatted at 2026-09-23 19:45:16 on dist-test-slave-xg7f"
server_key: "3ca7e0454830ab573656728e65fb6960"
server_key_iv: "6a8781077dd4b90ded169b07bcc47c5b"
server_key_version: "encryptionkey@0"
I20260923 19:46:02.602782 30206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:02.614434 30206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:02.618762 30206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:02.619045 30206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:02.637612 30206 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:35983
I20260923 19:46:02.637636 30272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:35983 every 8 connection(s)
I20260923 19:46:02.639163 30206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:02.641377 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 30206
I20260923 19:46:02.642376 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:40281
--local_ip_for_outbound_sockets=127.13.88.193
--tserver_master_addrs=127.13.88.254:35983
--webserver_port=43209
--webserver_interface=127.13.88.193
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:46:02.648660 30273 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:46:02.653028 30273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Bootstrap starting.
I20260923 19:46:02.674026 30273 log.cc:824] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:02.690001 30273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:46:02.690608 30273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: Bootstrap complete.
I20260923 19:46:02.699831 30273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:46:02.700695 30273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 596a86ffb523483889e1ce0313d682e5, State: Initialized, Role: FOLLOWER
I20260923 19:46:02.701421 30273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:46:02.701673 30273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:02.701794 30273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:02.701987 30273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:46:02.705852 30273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:46:02.706485 30273 leader_election.cc:302] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 596a86ffb523483889e1ce0313d682e5; no voters:
I20260923 19:46:02.707206 30273 leader_election.cc:288] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 19:46:02.707357 30277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 19:46:02.708534 30277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [term 3 LEADER]: Becoming Leader. State: Replica: 596a86ffb523483889e1ce0313d682e5, State: Running, Role: LEADER
I20260923 19:46:02.709074 30277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } }
I20260923 19:46:02.709450 30273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:02.711604 30279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 596a86ffb523483889e1ce0313d682e5. Latest consensus state: current_term: 3 leader_uuid: "596a86ffb523483889e1ce0313d682e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } } }
I20260923 19:46:02.712085 30279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:02.712769 30278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "596a86ffb523483889e1ce0313d682e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "596a86ffb523483889e1ce0313d682e5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 35983 } } }
I20260923 19:46:02.713063 30278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:02.721860 30292 catalog_manager.cc:1259] Loaded cluster ID: 64f38519eb89481dba42b7f71f27a693
I20260923 19:46:02.722097 30292 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: loading cluster ID for follower catalog manager: success
I20260923 19:46:02.727670 30292 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 596a86ffb523483889e1ce0313d682e5: acquiring CA information for follower catalog manager: success
F20260923 19:46:02.731244 30292 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7feed2ea09ad google::LogMessage::Fail() at ??:0
@ 0x7feed2ea388a google::LogMessage::SendToLog() at ??:0
@ 0x7feed2ea04de google::LogMessage::Flush() at ??:0
@ 0x7feed2ea1a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7feed6c047d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7feee88d5bbf kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7feee88d517b kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7feee88c4247 kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7feee88bdc56 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7feee895800c kudu::master::CatalogManagerBgTasks::Init()::$_0::operator()() at ??:0
@ 0x7feee8957e89 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7feed5acaeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7feed8da46db start_thread at ??:0
@ 0x7feed1d3a61f clone at ??:0
W20260923 19:46:03.022619 30275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:03.022897 30275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:03.022994 30275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:03.030414 30275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:03.030542 30275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:03.030670 30275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:46:03.040911 30275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:40281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=43209
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:03.042147 30275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:03.043391 30275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:03.056418 30314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:03.056381 30313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:03.056466 30316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:03.057106 30275 server_base.cc:1034] running on GCE node
I20260923 19:46:03.057751 30275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:03.058660 30275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:03.059877 30275 hybrid_clock.cc:648] HybridClock initialized: now 1790192763059831 us; error 62 us; skew 500 ppm
I20260923 19:46:03.060192 30275 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:03 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192763, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:03.063136 30275 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:46:03.064484 30275 webserver.cc:460] Webserver started at http://127.13.88.193:43209/ using document root <none> and password file <none>
I20260923 19:46:03.065145 30275 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:03.065282 30275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:03.070564 30275 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:46:03.073340 30323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:03.074644 30275 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:46:03.074808 30275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "8b90c5fa6b37485285f4074892796751"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "425326d12b3d876d78ceb93d6b2ac929"
server_key_iv: "49a03076ac6052bd8851b93e1dc70344"
server_key_version: "encryptionkey@0"
I20260923 19:46:03.075804 30275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:03.091291 30275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:03.094935 30275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:03.095263 30275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:03.096192 30275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:03.097924 30330 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260923 19:46:03.103688 30275 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 19:46:03.103839 30275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260923 19:46:03.103984 30275 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 19:46:03.107149 30275 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 19:46:03.107271 30275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:03.107791 30330 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Bootstrap starting.
I20260923 19:46:03.136585 30330 log.cc:824] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:03.145622 30275 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:40281
I20260923 19:46:03.145655 30437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:40281 every 8 connection(s)
I20260923 19:46:03.147294 30275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:46:03.151223 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 30275
I20260923 19:46:03.151968 30330 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:46:03.151991 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:41275
--local_ip_for_outbound_sockets=127.13.88.194
--tserver_master_addrs=127.13.88.254:35983
--webserver_port=34349
--webserver_interface=127.13.88.194
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:46:03.152495 30330 tablet_bootstrap.cc:492] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Bootstrap complete.
I20260923 19:46:03.153153 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.150269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:48693)
0923 19:46:03.151388 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.151694 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":422,"threads_started":1}
I20260923 19:46:03.153932 30330 ts_tablet_manager.cc:1397] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Time spent bootstrapping tablet: real 0.047s user 0.027s sys 0.016s
W20260923 19:46:03.153942 30438 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:35983 (0 consecutive failures): Network error: Failed to ping master at 127.13.88.254:35983: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
I20260923 19:46:03.155009 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.154558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:53487)
0923 19:46:03.154745 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.154838 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 19:46:03.156170 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.155677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:42479)
0923 19:46:03.155859 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.155974 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:46:03.156435 30438 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:46:03.160641 30330 raft_consensus.cc:348] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:46:03.161474 30330 raft_consensus.cc:729] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b90c5fa6b37485285f4074892796751, State: Initialized, Role: FOLLOWER
I20260923 19:46:03.162004 30330 consensus_queue.cc:260] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:46:03.163532 30330 ts_tablet_manager.cc:1428] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751: Time spent starting tablet: real 0.009s user 0.010s sys 0.001s
I20260923 19:46:03.163672 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.163263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:47895)
0923 19:46:03.163418 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.163501 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 19:46:03.164510 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.164245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:48119)
0923 19:46:03.164358 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.164412 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260923 19:46:03.478370 30441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:03.478680 30441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:03.478838 30441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:03.486142 30441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:03.486268 30441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:03.486438 30441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:46:03.496294 30441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:41275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=34349
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:03.497589 30441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:03.498858 30441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:03.511850 30448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:03.511912 30447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:03.511869 30450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:03.512609 30441 server_base.cc:1034] running on GCE node
I20260923 19:46:03.513173 30441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:03.514066 30441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:03.515281 30441 hybrid_clock.cc:648] HybridClock initialized: now 1790192763515237 us; error 38 us; skew 500 ppm
I20260923 19:46:03.515599 30441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:03 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192763, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:03.518875 30441 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:46:03.520754 30441 webserver.cc:460] Webserver started at http://127.13.88.194:34349/ using document root <none> and password file <none>
I20260923 19:46:03.521453 30441 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:03.521620 30441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:03.526998 30441 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:46:03.529656 30457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:03.530975 30441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:46:03.531217 30441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "9d9fa0dd730040149d80191b915a3aa9"
format_stamp: "Formatted at 2026-09-23 19:45:17 on dist-test-slave-xg7f"
server_key: "e77134945acbdcc110bbee409d2e65b4"
server_key_iv: "e68bf69058b57716d477b41742f2d241"
server_key_version: "encryptionkey@0"
I20260923 19:46:03.532215 30441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:03.583053 30441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:03.588003 30441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:03.588315 30441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:03.589335 30441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:03.590711 30441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:03.590837 30441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:03.590996 30441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:03.591087 30441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:03.624738 30441 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:41275
I20260923 19:46:03.624822 30569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:41275 every 8 connection(s)
I20260923 19:46:03.626185 30441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:46:03.627379 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 30441
I20260923 19:46:03.628150 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:35637
--local_ip_for_outbound_sockets=127.13.88.195
--tserver_master_addrs=127.13.88.254:35983
--webserver_port=35719
--webserver_interface=127.13.88.195
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:46:03.631631 30572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.629690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:52861)
0923 19:46:03.630462 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.630714 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":300,"threads_started":1}
W20260923 19:46:03.632252 30570 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:35983 (0 consecutive failures): Network error: Failed to ping master at 127.13.88.254:35983: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
I20260923 19:46:03.633131 30572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.632805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:53439)
0923 19:46:03.632962 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.633028 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 19:46:03.633971 30572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:03.633636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:46711)
0923 19:46:03.633774 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:03.633857 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:46:03.634191 30570 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 19:46:03.957044 30573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:03.957317 30573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:03.957410 30573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:03.964725 30573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:03.964838 30573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:03.964959 30573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:46:03.974628 30573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:35637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=35719
--tserver_master_addrs=127.13.88.254:35983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:03.975870 30573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:03.977147 30573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:03.990047 30581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:03.990157 30578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:03.990185 30579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:03.991631 30573 server_base.cc:1034] running on GCE node
I20260923 19:46:03.992224 30573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:03.993175 30573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:03.994386 30573 hybrid_clock.cc:648] HybridClock initialized: now 1790192763994330 us; error 51 us; skew 500 ppm
I20260923 19:46:03.994680 30573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:03 dist-test-slave-xg7f krb5kdc[29126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192763, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:03.997843 30573 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:46:03.999341 30573 webserver.cc:460] Webserver started at http://127.13.88.195:35719/ using document root <none> and password file <none>
I20260923 19:46:03.999984 30573 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:04.000080 30573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:04.005234 30573 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 19:46:04.007747 30588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:04.009014 30573 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:04.009187 30573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "5d5829202cd2491cad8a0da7a4783192"
format_stamp: "Formatted at 2026-09-23 19:45:18 on dist-test-slave-xg7f"
server_key: "af5d98242c9f2c6912417bba16719a6b"
server_key_iv: "b45c934dc03223636c8b972f9b8df773"
server_key_version: "encryptionkey@0"
I20260923 19:46:04.010113 30573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:04.035660 30573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:04.040282 30573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:04.040565 30573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:04.041604 30573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:04.042992 30573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:04.043111 30573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:04.043249 30573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:04.043342 30573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:04.075855 30573 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:35637
I20260923 19:46:04.075951 30700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:35637 every 8 connection(s)
I20260923 19:46:04.077337 30573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:46:04.082450 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.080416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:53801)
0923 19:46:04.081190 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:04.081422 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":285,"threads_started":1}
I20260923 19:46:04.082520 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 30573
W20260923 19:46:04.083238 30701 heartbeater.cc:644] Failed to heartbeat to 127.13.88.254:35983 (0 consecutive failures): Network error: Failed to ping master at 127.13.88.254:35983: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
I20260923 19:46:04.084149 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.083747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:49651)
0923 19:46:04.083924 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:04.084009 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:46:04.084983 30703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.084671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:53205)
0923 19:46:04.084804 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:04.084880 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 19:46:04.085208 30701 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 19:46:04.166128 30705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.165334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:60271)
0923 19:46:04.165829 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:04.165920 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":258,"threads_started":1}
I20260923 19:46:04.635600 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.634761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:49495)
0923 19:46:04.635285 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:04.635370 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":247,"threads_started":1}
I20260923 19:46:04.786685 30707 raft_consensus.cc:482] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:04.786967 30707 raft_consensus.cc:504] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:46:04.788538 30707 leader_election.cc:288] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637), 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
Sep 23 19:46:04 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192763, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
Sep 23 19:46:04 dist-test-slave-xg7f krb5kdc[29126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192763, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:46:04.814939 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.788859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:35637 (local address 127.13.88.193:45059)
0923 19:46:04.791640 (+ 2781us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:04.791685 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:04.792277 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:04.796496 (+ 4219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:04.796508 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:04.797437 (+ 929us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:04.798223 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:04.798242 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.799825 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.799828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:04.801319 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:04.801331 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.802300 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.802306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:04.802583 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:04.803388 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:04.803405 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:04.805865 (+ 2460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:04.810624 (+ 4759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:04.810635 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:04.810652 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:04.811492 (+ 840us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:04.811998 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:04.812004 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:04.812008 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:04.812332 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:04.813350 (+ 1018us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:04.813354 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:04.813817 (+ 463us) client_negotiation.cc:769] Sending connection context
0923 19:46:04.814181 (+ 364us) client_negotiation.cc:240] Negotiation successful
0923 19:46:04.814599 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2589,"mutex_wait_us":216,"spinlock_wait_cycles":19328,"thread_start_us":2426,"threads_started":1}
I20260923 19:46:04.815234 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.792054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:41275 (local address 127.13.88.193:53051)
0923 19:46:04.793072 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:04.793088 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:04.793204 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:04.796961 (+ 3757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:04.796965 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:04.797625 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:04.798223 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:04.798243 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.799809 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.799818 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:04.801319 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:04.801331 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.802352 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.802359 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:04.802584 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:04.803336 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:04.803357 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:04.806198 (+ 2841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:04.810624 (+ 4426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:04.810635 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:04.810652 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:04.811492 (+ 840us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:04.811998 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:04.812004 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:04.812008 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:04.812332 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:04.813335 (+ 1003us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:04.813343 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:04.813817 (+ 474us) client_negotiation.cc:769] Sending connection context
0923 19:46:04.814208 (+ 391us) client_negotiation.cc:240] Negotiation successful
0923 19:46:04.814770 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":327,"spinlock_wait_cycles":28032,"thread_start_us":689,"threads_started":1}
I20260923 19:46:04.815531 30711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.792170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:53051 (local address 127.13.88.194:41275)
0923 19:46:04.792888 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:04.792906 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:04.793194 (+ 288us) server_negotiation.cc:407] Connection header received
0923 19:46:04.795542 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:04.795551 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:04.795968 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:04.796335 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:04.798415 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.799642 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.801477 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.802097 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.802307 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:04.806474 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:04.806483 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:04.806500 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:04.806546 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:04.810447 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:04.811632 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:04.811641 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:04.811650 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:04.811850 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:04.812456 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:04.812460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:04.812463 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:04.813150 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:04.813338 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:04.814663 (+ 1325us) server_negotiation.cc:299] Negotiation successful
0923 19:46:04.815079 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":338,"threads_started":1}
I20260923 19:46:04.816437 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:04.789023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:45059 (local address 127.13.88.195:35637)
0923 19:46:04.793263 (+ 4240us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:04.793277 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:04.793308 (+ 31us) server_negotiation.cc:407] Connection header received
0923 19:46:04.795461 (+ 2153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:04.795473 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:04.795968 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:04.796335 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:04.798415 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.799625 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.801465 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:04.802097 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:04.802290 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:04.806175 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:04.806182 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:04.806197 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:04.806233 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:04.810475 (+ 4242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:04.811632 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:04.811641 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:04.811650 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:04.811846 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:04.812466 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:04.812472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:04.812474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:04.813153 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:04.813394 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:04.815856 (+ 2462us) server_negotiation.cc:299] Negotiation successful
0923 19:46:04.816165 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4067,"thread_start_us":3964,"threads_started":1}
W20260923 19:46:04.818714 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
W20260923 19:46:04.819105 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
I20260923 19:46:04.819293 30325 leader_election.cc:302] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b90c5fa6b37485285f4074892796751; no voters: 5d5829202cd2491cad8a0da7a4783192, 9d9fa0dd730040149d80191b915a3aa9
I20260923 19:46:04.819758 30707 raft_consensus.cc:2726] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:46:05.086511 30712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:05.085696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:41397)
0923 19:46:05.086132 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:05.086283 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":215,"threads_started":1}
I20260923 19:46:05.167490 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:05.166978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:47461)
0923 19:46:05.167187 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:05.167342 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:46:05.637427 30713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:05.636548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:51981)
0923 19:46:05.637139 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:05.637223 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":356,"threads_started":1}
I20260923 19:46:06.088086 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:06.087447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:45347)
0923 19:46:06.087848 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:06.087925 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":200,"threads_started":1}
I20260923 19:46:06.169175 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:06.168350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:39617)
0923 19:46:06.168889 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:06.168986 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":228,"threads_started":1}
I20260923 19:46:06.638957 30716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:06.638272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:42961)
0923 19:46:06.638703 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:06.638787 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":224,"threads_started":1}
I20260923 19:46:06.866962 30717 raft_consensus.cc:482] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:06.867199 30717 raft_consensus.cc:504] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:46:06.867830 30717 leader_election.cc:288] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637), 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
W20260923 19:46:06.868901 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
W20260923 19:46:06.869158 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
I20260923 19:46:06.869271 30325 leader_election.cc:302] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b90c5fa6b37485285f4074892796751; no voters: 5d5829202cd2491cad8a0da7a4783192, 9d9fa0dd730040149d80191b915a3aa9
I20260923 19:46:06.869537 30717 raft_consensus.cc:2726] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:46:07.089684 30718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:07.089027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:57455)
0923 19:46:07.089435 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:07.089511 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":217,"threads_started":1}
I20260923 19:46:07.170969 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:07.170136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:58269)
0923 19:46:07.170614 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:07.170734 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":214,"threads_started":1}
I20260923 19:46:07.640488 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:07.639819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:40169)
0923 19:46:07.640239 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:07.640316 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":210,"threads_started":1}
I20260923 19:46:08.091202 30721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:08.090474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:38693)
0923 19:46:08.090895 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:08.090970 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":212,"threads_started":1}
I20260923 19:46:08.172727 30722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:08.172050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:59141)
0923 19:46:08.172466 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:08.172558 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":226,"threads_started":1}
I20260923 19:46:08.642020 30723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:08.641331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:54489)
0923 19:46:08.641776 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:08.641866 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":238,"threads_started":1}
I20260923 19:46:09.072482 30724 raft_consensus.cc:482] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:09.072666 30724 raft_consensus.cc:504] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:46:09.073212 30724 leader_election.cc:288] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637), 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
W20260923 19:46:09.074285 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
W20260923 19:46:09.074509 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
I20260923 19:46:09.074638 30325 leader_election.cc:302] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b90c5fa6b37485285f4074892796751; no voters: 5d5829202cd2491cad8a0da7a4783192, 9d9fa0dd730040149d80191b915a3aa9
I20260923 19:46:09.074978 30724 raft_consensus.cc:2726] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:46:09.092696 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:09.092041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:42599)
0923 19:46:09.092458 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:09.092534 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":236,"threads_started":1}
I20260923 19:46:09.174479 30726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:09.173734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:44669)
0923 19:46:09.174199 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:09.174290 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":235,"threads_started":1}
I20260923 19:46:09.643735 30727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:09.642920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:56537)
0923 19:46:09.643470 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:09.643554 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":341,"threads_started":1}
I20260923 19:46:10.094434 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:10.093716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:47125)
0923 19:46:10.094187 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:10.094265 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":255,"threads_started":1}
I20260923 19:46:10.176107 30729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:10.175402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:53209)
0923 19:46:10.175816 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:10.175900 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":221,"threads_started":1}
I20260923 19:46:10.645503 30730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:10.644616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:46491)
0923 19:46:10.645204 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:10.645309 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":293,"threads_started":1}
I20260923 19:46:11.096302 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:11.095572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:49267)
0923 19:46:11.096045 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:11.096122 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":213,"threads_started":1}
I20260923 19:46:11.177632 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:11.176937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:39661)
0923 19:46:11.177380 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:11.177472 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":229,"threads_started":1}
I20260923 19:46:11.647073 30733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:11.646362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:35289)
0923 19:46:11.646782 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:11.646888 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":214,"threads_started":1}
I20260923 19:46:12.097889 30734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:12.097201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:36229)
0923 19:46:12.097617 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:12.097706 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":218,"threads_started":1}
I20260923 19:46:12.179430 30735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:12.178566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:52577)
0923 19:46:12.179079 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:12.179254 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":251,"threads_started":1}
I20260923 19:46:12.184329 30736 raft_consensus.cc:482] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:12.184551 30736 raft_consensus.cc:504] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:46:12.185271 30736 leader_election.cc:288] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637), 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
W20260923 19:46:12.186152 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
W20260923 19:46:12.186334 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
I20260923 19:46:12.186403 30325 leader_election.cc:302] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b90c5fa6b37485285f4074892796751; no voters: 5d5829202cd2491cad8a0da7a4783192, 9d9fa0dd730040149d80191b915a3aa9
I20260923 19:46:12.186617 30736 raft_consensus.cc:2726] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:46:12.648716 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:12.647996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:52475)
0923 19:46:12.648477 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:12.648563 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":227,"threads_started":1}
I20260923 19:46:13.099732 30738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:13.098889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:35409)
0923 19:46:13.099468 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:13.099564 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":316,"threads_started":1}
I20260923 19:46:13.181221 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:13.180511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:60459)
0923 19:46:13.180965 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:13.181053 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":222,"threads_started":1}
I20260923 19:46:13.650552 30740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:13.649726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:56425)
0923 19:46:13.650271 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:13.650355 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":335,"threads_started":1}
I20260923 19:46:14.101624 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:14.100791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:42913)
0923 19:46:14.101293 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:14.101398 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":231,"threads_started":1}
I20260923 19:46:14.182845 30742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:14.182101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:56975)
0923 19:46:14.182573 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:14.182655 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":256,"threads_started":1}
I20260923 19:46:14.652173 30743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:14.651489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:51315)
0923 19:46:14.651907 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:14.651996 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":208,"threads_started":1}
I20260923 19:46:15.103348 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:15.102601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:37389)
0923 19:46:15.103043 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:15.103184 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":226,"threads_started":1}
I20260923 19:46:15.184547 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:15.183783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:39413)
0923 19:46:15.184279 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:15.184385 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":256,"threads_started":1}
I20260923 19:46:15.653822 30746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:15.653120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:60547)
0923 19:46:15.653567 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:15.653651 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":238,"threads_started":1}
I20260923 19:46:15.977994 30747 raft_consensus.cc:482] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:15.978225 30747 raft_consensus.cc:504] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d5829202cd2491cad8a0da7a4783192" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 35637 } } peers { permanent_uuid: "8b90c5fa6b37485285f4074892796751" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40281 } } peers { permanent_uuid: "9d9fa0dd730040149d80191b915a3aa9" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 41275 } }
I20260923 19:46:15.978825 30747 leader_election.cc:288] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637), 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275)
W20260923 19:46:15.979908 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d5829202cd2491cad8a0da7a4783192 (127.13.88.195:35637): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
W20260923 19:46:15.980129 30325 leader_election.cc:341] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9d9fa0dd730040149d80191b915a3aa9 (127.13.88.194:41275): Not found: Tablet not found: 293a0bc5bfa44b39ae04691353c72e46
I20260923 19:46:15.980257 30325 leader_election.cc:302] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b90c5fa6b37485285f4074892796751; no voters: 5d5829202cd2491cad8a0da7a4783192, 9d9fa0dd730040149d80191b915a3aa9
I20260923 19:46:15.980578 30747 raft_consensus.cc:2726] T 293a0bc5bfa44b39ae04691353c72e46 P 8b90c5fa6b37485285f4074892796751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:46:16.105207 30748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:16.104309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:44145)
0923 19:46:16.104943 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:16.105032 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":410,"threads_started":1}
I20260923 19:46:16.186373 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:16.185553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:59797)
0923 19:46:16.186074 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:16.186173 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":245,"threads_started":1}
I20260923 19:46:16.655481 30750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:16.654738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:36451)
0923 19:46:16.655207 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:16.655299 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":220,"threads_started":1}
I20260923 19:46:17.106945 30751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:17.106203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:49211)
0923 19:46:17.106683 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:17.106772 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":285,"threads_started":1}
I20260923 19:46:17.188122 30752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:17.187389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:56301)
0923 19:46:17.187851 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:17.187929 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":249,"threads_started":1}
I20260923 19:46:17.657153 30753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:17.656464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:54955)
0923 19:46:17.656880 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:17.656962 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":217,"threads_started":1}
I20260923 19:46:18.108711 30754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:18.107800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:42805)
0923 19:46:18.108253 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:18.108465 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":232,"threads_started":1}
I20260923 19:46:18.190059 30755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:18.189291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.193:59449)
0923 19:46:18.189777 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:18.189892 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":265,"threads_started":1}
I20260923 19:46:18.659353 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:18.658528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.194:56603)
0923 19:46:18.659003 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:18.659148 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":230,"threads_started":1}
I20260923 19:46:19.087186 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 30275
I20260923 19:46:19.102452 30757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:19.088319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37402 (local address 127.13.88.193:40281)
0923 19:46:19.089050 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:19.089064 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:19.089100 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:46:19.089186 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:19.089197 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:19.089531 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:19.089705 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:19.091165 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:19.092129 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:19.093355 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:19.093973 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:19.094070 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:19.096708 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:19.096720 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:19.096738 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:19.096784 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:19.099872 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:19.100562 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:19.100569 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:19.100572 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:19.100723 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:19.101117 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:19.101120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:19.101122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:19.101470 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:19.101701 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:19.101989 (+ 288us) server_negotiation.cc:299] Negotiation successful
0923 19:46:19.102202 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":406,"threads_started":1}
I20260923 19:46:19.103822 30433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:19.110607 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:19.109853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:35983 (local address 127.13.88.195:48971)
0923 19:46:19.110357 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:19.110454 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.254:35983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":265,"threads_started":1}
I20260923 19:46:19.195972 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 30275
I20260923 19:46:19.213158 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 30441
I20260923 19:46:19.226220 30761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:19.214013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.13.88.194:41275)
0923 19:46:19.214531 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:19.214537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:19.214565 (+ 28us) server_negotiation.cc:407] Connection header received
0923 19:46:19.214622 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:19.214625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:19.214707 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:19.214796 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:19.216290 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:19.217035 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:19.218203 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:19.218621 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:19.218709 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:19.221245 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:19.221250 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:19.221254 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:19.221288 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:19.223839 (+ 2551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:19.224461 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:19.224465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:19.224467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:19.224597 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:19.224898 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:19.224901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:19.224902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:19.225152 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:19.225350 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:19.225605 (+ 255us) server_negotiation.cc:299] Negotiation successful
0923 19:46:19.225762 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":233,"threads_started":1}
I20260923 19:46:19.226925 30565 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:19.308858 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 30441
I20260923 19:46:19.326037 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 30573
I20260923 19:46:19.339304 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:19.326960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46464 (local address 127.13.88.195:35637)
0923 19:46:19.327594 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:19.327598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:19.327615 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:46:19.327672 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:19.327676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:19.327732 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:19.327820 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:19.329122 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:19.329897 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:19.331148 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:19.331582 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:19.331673 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:19.334107 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:19.334112 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:19.334115 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:19.334147 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:19.336947 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:19.337527 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:19.337531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:19.337533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:19.337648 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:19.337961 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:19.337964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:19.337966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:19.338211 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:19.338399 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:19.338622 (+ 223us) server_negotiation.cc:299] Negotiation successful
0923 19:46:19.338770 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":371,"threads_started":1}
I20260923 19:46:19.340016 30696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:19.423355 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 30573
2026-09-23T19:46:19Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64388 ms)
[----------] 30 tests from SecurityITest (290095 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:19 dist-test-slave-xg7f krb5kdc[30767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:19 dist-test-slave-xg7f krb5kdc[30767](info): set up 2 sockets
Sep 23 19:46:19 dist-test-slave-xg7f krb5kdc[30767](info): commencing operation
krb5kdc: starting...
W20260923 19:46:20.523077 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:20 dist-test-slave-xg7f krb5kdc[30767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:46:20.758203 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38937
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:38937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:21.079335 30780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:21.079670 30780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:21.079856 30780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:21.087051 30780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:21.087175 30780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:21.087267 30780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:21.087363 30780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:21.087452 30780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:21.097204 30780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:38937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:38937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:21.098506 30780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:21.099864 30780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:21.111893 30785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:21.111855 30788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:21.111933 30786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:21.112674 30780 server_base.cc:1034] running on GCE node
I20260923 19:46:21.113337 30780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:21.114652 30780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:21.115845 30780 hybrid_clock.cc:648] HybridClock initialized: now 1790192781115798 us; error 42 us; skew 500 ppm
I20260923 19:46:21.116191 30780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:21 dist-test-slave-xg7f krb5kdc[30767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192781, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:21.119232 30780 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:46:21.120558 30780 webserver.cc:460] Webserver started at http://127.13.88.254:43491/ using document root <none> and password file <none>
I20260923 19:46:21.121162 30780 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:21.121256 30780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:21.121490 30780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:21.124295 30780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "df3219ead70d4eb9b9d66f14aec608eb"
format_stamp: "Formatted at 2026-09-23 19:46:21 on dist-test-slave-xg7f"
server_key: "d051b3866196fa171f8653f4bbaf702c"
server_key_iv: "33687080d8ae27cb2864f199dfc881d3"
server_key_version: "encryptionkey@0"
I20260923 19:46:21.124987 30780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "df3219ead70d4eb9b9d66f14aec608eb"
format_stamp: "Formatted at 2026-09-23 19:46:21 on dist-test-slave-xg7f"
server_key: "d051b3866196fa171f8653f4bbaf702c"
server_key_iv: "33687080d8ae27cb2864f199dfc881d3"
server_key_version: "encryptionkey@0"
I20260923 19:46:21.129711 30780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 19:46:21.132984 30795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:21.134227 30780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:46:21.134394 30780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "df3219ead70d4eb9b9d66f14aec608eb"
format_stamp: "Formatted at 2026-09-23 19:46:21 on dist-test-slave-xg7f"
server_key: "d051b3866196fa171f8653f4bbaf702c"
server_key_iv: "33687080d8ae27cb2864f199dfc881d3"
server_key_version: "encryptionkey@0"
I20260923 19:46:21.134568 30780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:21.147663 30780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:21.151736 30780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:21.152040 30780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:21.170377 30780 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:38937
I20260923 19:46:21.170408 30846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:38937 every 8 connection(s)
I20260923 19:46:21.171864 30780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:21.175732 30847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:21.179504 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 30780
I20260923 19:46:21.179720 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:21.180536 13667 external_mini_cluster.cc:1428] Setting key fa7b99ac4bbcd03d35ac79de91855a06
I20260923 19:46:21.189136 30847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb: Bootstrap starting.
I20260923 19:46:21.193055 30847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:21.194384 30847 log.cc:824] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:46:21 dist-test-slave-xg7f krb5kdc[30767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:21.197623 30847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb: No bootstrap required, opened a new log
I20260923 19:46:21.205374 30850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:21.182560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35368 (local address 127.13.88.254:38937)
0923 19:46:21.183356 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:21.183373 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:21.183414 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:46:21.185019 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:21.185041 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:21.185450 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:21.185773 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:21.187567 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:21.188805 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:21.190688 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:21.191500 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:21.191623 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:21.196734 (+ 5111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:21.196746 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:21.196766 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:21.196815 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:21.200801 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:21.201482 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:21.201490 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:21.201499 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:21.201712 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:21.202088 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:21.202093 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:21.202098 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:21.202785 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:21.203124 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:21.203542 (+ 418us) server_negotiation.cc:299] Negotiation successful
0923 19:46:21.204013 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":370,"threads_started":1}
I20260923 19:46:21.208354 30847 raft_consensus.cc:348] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df3219ead70d4eb9b9d66f14aec608eb" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38937 } }
I20260923 19:46:21.208715 30847 raft_consensus.cc:374] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:21.208789 30847 raft_consensus.cc:729] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df3219ead70d4eb9b9d66f14aec608eb, State: Initialized, Role: FOLLOWER
I20260923 19:46:21.209237 30847 consensus_queue.cc:260] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df3219ead70d4eb9b9d66f14aec608eb" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38937 } }
I20260923 19:46:21.209434 30847 raft_consensus.cc:388] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:21.209524 30847 raft_consensus.cc:482] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:21.209671 30847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:21.212054 30847 raft_consensus.cc:504] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df3219ead70d4eb9b9d66f14aec608eb" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38937 } }
I20260923 19:46:21.212518 30847 leader_election.cc:302] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df3219ead70d4eb9b9d66f14aec608eb; no voters:
I20260923 19:46:21.213025 30847 leader_election.cc:288] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:21.213155 30852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:21.213792 30852 raft_consensus.cc:686] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [term 1 LEADER]: Becoming Leader. State: Replica: df3219ead70d4eb9b9d66f14aec608eb, State: Running, Role: LEADER
I20260923 19:46:21.214330 30852 consensus_queue.cc:237] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df3219ead70d4eb9b9d66f14aec608eb" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38937 } }
I20260923 19:46:21.215006 30847 sys_catalog.cc:564] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:21.217069 30853 sys_catalog.cc:455] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df3219ead70d4eb9b9d66f14aec608eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df3219ead70d4eb9b9d66f14aec608eb" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38937 } } }
I20260923 19:46:21.217478 30853 sys_catalog.cc:458] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:21.217438 30854 sys_catalog.cc:455] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader df3219ead70d4eb9b9d66f14aec608eb. Latest consensus state: current_term: 1 leader_uuid: "df3219ead70d4eb9b9d66f14aec608eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df3219ead70d4eb9b9d66f14aec608eb" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 38937 } } }
I20260923 19:46:21.217741 30854 sys_catalog.cc:458] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:21.218375 30859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:21.225780 30859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:21.237563 30859 catalog_manager.cc:1347] Generated new cluster ID: fea8abe5906e43ffa583bc06977f3d44
I20260923 19:46:21.237690 30859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:21.255930 30859 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:21.257264 30859 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:21.264117 30859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb: Generated new TSK 0
I20260923 19:46:21.265229 30859 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:46:21.324388 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38937
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:21.654088 30873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:21.654397 30873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:21.654564 30873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:21.661841 30873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:21.661986 30873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:21.662155 30873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:46:21.674340 30873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38937
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:21.675702 30873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:21.677011 30873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:21.690106 30878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:21.689930 30881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:21.690126 30879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:21.690994 30873 server_base.cc:1034] running on GCE node
I20260923 19:46:21.691593 30873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:21.692485 30873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:21.693717 30873 hybrid_clock.cc:648] HybridClock initialized: now 1790192781693683 us; error 47 us; skew 500 ppm
I20260923 19:46:21.694027 30873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:21 dist-test-slave-xg7f krb5kdc[30767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192781, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:21.697082 30873 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:46:21.698472 30873 webserver.cc:460] Webserver started at http://127.13.88.193:34989/ using document root <none> and password file <none>
I20260923 19:46:21.699179 30873 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:21.699324 30873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:21.699630 30873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:21.702371 30873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "963c579606c24ce28faa3dd40beb2138"
format_stamp: "Formatted at 2026-09-23 19:46:21 on dist-test-slave-xg7f"
server_key: "14062b84e23617b662d1a99f47ac4916"
server_key_iv: "5b3b3cfacc84031f01166c010ce25518"
server_key_version: "encryptionkey@0"
I20260923 19:46:21.703190 30873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "963c579606c24ce28faa3dd40beb2138"
format_stamp: "Formatted at 2026-09-23 19:46:21 on dist-test-slave-xg7f"
server_key: "14062b84e23617b662d1a99f47ac4916"
server_key_iv: "5b3b3cfacc84031f01166c010ce25518"
server_key_version: "encryptionkey@0"
I20260923 19:46:21.708628 30873 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:46:21.711863 30888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:21.713037 30873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:46:21.713224 30873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "963c579606c24ce28faa3dd40beb2138"
format_stamp: "Formatted at 2026-09-23 19:46:21 on dist-test-slave-xg7f"
server_key: "14062b84e23617b662d1a99f47ac4916"
server_key_iv: "5b3b3cfacc84031f01166c010ce25518"
server_key_version: "encryptionkey@0"
I20260923 19:46:21.713415 30873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:21.736197 30873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:21.740293 30873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:21.740594 30873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:21.741592 30873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:21.742897 30873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:21.743007 30873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:21.743186 30873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:21.743263 30873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:21.776680 30873 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:41003
I20260923 19:46:21.776769 31000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:41003 every 8 connection(s)
I20260923 19:46:21.778003 30873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:46:21.779378 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 30873
I20260923 19:46:21.779588 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:46:21.780437 13667 external_mini_cluster.cc:1428] Setting key 3e2c01aec81c3d9c48fb83b56d86633c
Sep 23 19:46:21 dist-test-slave-xg7f krb5kdc[30767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192781, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:21.801144 31003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:21.781142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:42651 (local address 127.13.88.254:38937)
0923 19:46:21.781627 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:21.781631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:21.782906 (+ 1275us) server_negotiation.cc:407] Connection header received
0923 19:46:21.785833 (+ 2927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:21.785837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:21.785902 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:21.786008 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:21.788200 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:21.788945 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:21.791483 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:21.791884 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:21.792032 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:21.795694 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:21.795698 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:21.795701 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:21.795732 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:21.798156 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:21.798850 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:21.798859 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:21.798861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:21.798964 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:21.799422 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:21.799427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:21.799430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:21.799703 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:21.799857 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:21.800548 (+ 691us) server_negotiation.cc:299] Negotiation successful
0923 19:46:21.800772 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":238,"threads_started":1}
I20260923 19:46:21.802119 31004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:21.781790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38937 (local address 127.13.88.193:42651)
0923 19:46:21.782702 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:21.782772 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:21.785517 (+ 2745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:21.786299 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:21.786313 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:21.787157 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:21.787984 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:21.788014 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:21.789124 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:21.789133 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:21.791324 (+ 2191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:21.791342 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:21.792138 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:21.792146 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:21.792386 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:21.793074 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:21.793096 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:21.795464 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:21.798300 (+ 2836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:21.798310 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:21.798326 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:21.798725 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:21.799084 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:21.799093 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:21.799097 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:21.799307 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:21.799842 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:21.799849 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:21.800165 (+ 316us) client_negotiation.cc:769] Sending connection context
0923 19:46:21.800438 (+ 273us) client_negotiation.cc:240] Negotiation successful
0923 19:46:21.800959 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":305,"threads_started":1}
I20260923 19:46:21.803777 31001 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38937
I20260923 19:46:21.804117 31001 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:21.805017 31001 heartbeater.cc:511] Master 127.13.88.254:38937 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:46:21.807490 30812 ts_manager.cc:194] Registered new tserver with Master: 963c579606c24ce28faa3dd40beb2138 (127.13.88.193:41003)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
I20260923 19:46:21.809345 30812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:42651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:46:21.836083 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38937
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:22.152599 31007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:22.152863 31007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:22.153028 31007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:22.160491 31007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:22.160588 31007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:22.160791 31007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:46:22.170252 31007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38937
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:22.171586 31007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:22.172883 31007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:22.185632 31015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:22.185660 31013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:22.186556 31012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:22.187024 31007 server_base.cc:1034] running on GCE node
I20260923 19:46:22.187619 31007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:22.188556 31007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:22.189783 31007 hybrid_clock.cc:648] HybridClock initialized: now 1790192782189739 us; error 51 us; skew 500 ppm
I20260923 19:46:22.190088 31007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:22 dist-test-slave-xg7f krb5kdc[30767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192782, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:22.193140 31007 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:46:22.194520 31007 webserver.cc:460] Webserver started at http://127.13.88.194:37715/ using document root <none> and password file <none>
I20260923 19:46:22.195236 31007 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:22.195379 31007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:22.195672 31007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:22.198552 31007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "cc1c968761af40cfaeff016368ad1398"
format_stamp: "Formatted at 2026-09-23 19:46:22 on dist-test-slave-xg7f"
server_key: "c77b0786b63a2eb7b4504b1a0c7a2392"
server_key_iv: "df89df2a93a97c4580719a68f26d452a"
server_key_version: "encryptionkey@0"
I20260923 19:46:22.199397 31007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "cc1c968761af40cfaeff016368ad1398"
format_stamp: "Formatted at 2026-09-23 19:46:22 on dist-test-slave-xg7f"
server_key: "c77b0786b63a2eb7b4504b1a0c7a2392"
server_key_iv: "df89df2a93a97c4580719a68f26d452a"
server_key_version: "encryptionkey@0"
I20260923 19:46:22.204483 31007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:46:22.208091 31022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:22.209362 31007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:22.209533 31007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "cc1c968761af40cfaeff016368ad1398"
format_stamp: "Formatted at 2026-09-23 19:46:22 on dist-test-slave-xg7f"
server_key: "c77b0786b63a2eb7b4504b1a0c7a2392"
server_key_iv: "df89df2a93a97c4580719a68f26d452a"
server_key_version: "encryptionkey@0"
I20260923 19:46:22.209726 31007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:22.230325 31007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:22.234226 31007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:22.234515 31007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:22.235522 31007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:22.236860 31007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:22.236967 31007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:22.237108 31007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:22.237185 31007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:22.269464 31007 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:43133
I20260923 19:46:22.269548 31134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:43133 every 8 connection(s)
I20260923 19:46:22.270740 31007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:46:22.277565 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31007
I20260923 19:46:22.277741 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:46:22.278159 13667 external_mini_cluster.cc:1428] Setting key ed512dac9c10049d9e7a6130265009b8
Sep 23 19:46:22 dist-test-slave-xg7f krb5kdc[30767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192782, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:22.292223 31003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.273298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:55191 (local address 127.13.88.254:38937)
0923 19:46:22.273489 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.273493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.274610 (+ 1117us) server_negotiation.cc:407] Connection header received
0923 19:46:22.276396 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.276419 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.276485 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.276572 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:22.278076 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.278965 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.280969 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.281398 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.281489 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.285475 (+ 3986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:22.285484 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:22.285492 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:22.285539 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:22.289038 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:22.289991 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:22.289994 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:22.289997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:22.290118 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:22.290576 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:22.290579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:22.290581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:22.290833 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:22.290939 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.291811 (+ 872us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.291981 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:46:22.293864 31137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.273762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38937 (local address 127.13.88.194:55191)
0923 19:46:22.274447 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:22.274490 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:22.276147 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:22.276762 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:22.276770 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:22.277255 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:22.277913 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.277937 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.279140 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.279146 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.280813 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.280829 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.281617 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.281627 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.281952 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.282637 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:22.282670 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:22.285219 (+ 2549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:22.289169 (+ 3950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:22.289180 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:22.289198 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:22.289869 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:22.290223 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:22.290230 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:22.290236 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:22.290470 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:22.290953 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:22.290964 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:22.291435 (+ 471us) client_negotiation.cc:769] Sending connection context
0923 19:46:22.291726 (+ 291us) client_negotiation.cc:240] Negotiation successful
0923 19:46:22.292266 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":257,"threads_started":1}
I20260923 19:46:22.295326 31135 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38937
I20260923 19:46:22.295630 31135 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:22.296312 31135 heartbeater.cc:511] Master 127.13.88.254:38937 requested a full tablet report, sending...
I20260923 19:46:22.297751 30812 ts_manager.cc:194] Registered new tserver with Master: cc1c968761af40cfaeff016368ad1398 (127.13.88.194:43133)
I20260923 19:46:22.298548 30812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:55191
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:46:22.333608 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38937
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:22.649396 31140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:22.649662 31140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:22.649755 31140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:22.656922 31140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:22.657028 31140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:22.657148 31140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:46:22.666877 31140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:38937
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:22.668138 31140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:22.669369 31140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:22.682595 31145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:22.682528 31146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:22.682549 31148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:22.683280 31140 server_base.cc:1034] running on GCE node
I20260923 19:46:22.683918 31140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:22.684798 31140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:22.686017 31140 hybrid_clock.cc:648] HybridClock initialized: now 1790192782685967 us; error 67 us; skew 500 ppm
I20260923 19:46:22.686316 31140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:22 dist-test-slave-xg7f krb5kdc[30767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192782, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:22.689349 31140 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:46:22.690686 31140 webserver.cc:460] Webserver started at http://127.13.88.195:43549/ using document root <none> and password file <none>
I20260923 19:46:22.691398 31140 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:22.691498 31140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:22.691743 31140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:22.694554 31140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "10e4a23b185a45b9b79f8d5d9d249f2a"
format_stamp: "Formatted at 2026-09-23 19:46:22 on dist-test-slave-xg7f"
server_key: "04efefff1502a4fe89fb6b5a8dab1e94"
server_key_iv: "41e7bf6d6fe318bb3b064b2d7c51dd8c"
server_key_version: "encryptionkey@0"
I20260923 19:46:22.695346 31140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "10e4a23b185a45b9b79f8d5d9d249f2a"
format_stamp: "Formatted at 2026-09-23 19:46:22 on dist-test-slave-xg7f"
server_key: "04efefff1502a4fe89fb6b5a8dab1e94"
server_key_iv: "41e7bf6d6fe318bb3b064b2d7c51dd8c"
server_key_version: "encryptionkey@0"
I20260923 19:46:22.700321 31140 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:46:22.703634 31155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:22.704866 31140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:22.704990 31140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "10e4a23b185a45b9b79f8d5d9d249f2a"
format_stamp: "Formatted at 2026-09-23 19:46:22 on dist-test-slave-xg7f"
server_key: "04efefff1502a4fe89fb6b5a8dab1e94"
server_key_iv: "41e7bf6d6fe318bb3b064b2d7c51dd8c"
server_key_version: "encryptionkey@0"
I20260923 19:46:22.705139 31140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:22.736301 31140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:22.740710 31140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:22.740995 31140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:22.742045 31140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:22.743461 31140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:22.743535 31140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:22.743709 31140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:22.743768 31140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:22.774519 31140 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:37279
I20260923 19:46:22.774560 31267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:37279 every 8 connection(s)
I20260923 19:46:22.775839 31140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:46:22.785310 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31140
I20260923 19:46:22.785499 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:46:22.786018 13667 external_mini_cluster.cc:1428] Setting key 2ec5c5d53f288ed4a3d14170a78134be
Sep 23 19:46:22 dist-test-slave-xg7f krb5kdc[30767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192782, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:22.795945 31003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.778557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:40007 (local address 127.13.88.254:38937)
0923 19:46:22.778765 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.778771 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.780075 (+ 1304us) server_negotiation.cc:407] Connection header received
0923 19:46:22.782549 (+ 2474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.782553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.782619 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.782708 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:22.784158 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.784893 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.787052 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.787490 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.787622 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.790845 (+ 3223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:22.790850 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:22.790853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:22.790884 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:22.793302 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:22.793911 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:22.793914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:22.793916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:22.794032 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:22.794394 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:22.794399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:22.794402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:22.794678 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:22.794784 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.795547 (+ 763us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.795697 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:46:22.796818 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.779061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:38937 (local address 127.13.88.195:40007)
0923 19:46:22.779887 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:22.779936 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:22.782279 (+ 2343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:22.782920 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:22.782928 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:22.783488 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:22.784020 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.784036 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.785034 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.785038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.786916 (+ 1878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.786931 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.787703 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.787711 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.787959 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.788601 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:22.788621 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:22.790649 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:22.793426 (+ 2777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:22.793432 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:22.793442 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:22.793808 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:22.794121 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:22.794125 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:22.794127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:22.794301 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:22.794800 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:22.794810 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:22.795238 (+ 428us) client_negotiation.cc:769] Sending connection context
0923 19:46:22.795457 (+ 219us) client_negotiation.cc:240] Negotiation successful
0923 19:46:22.795793 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":286,"threads_started":1}
I20260923 19:46:22.798022 31268 heartbeater.cc:347] Connected to a master server at 127.13.88.254:38937
I20260923 19:46:22.798300 31268 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:22.799228 31268 heartbeater.cc:511] Master 127.13.88.254:38937 requested a full tablet report, sending...
I20260923 19:46:22.800769 30812 ts_manager.cc:194] Registered new tserver with Master: 10e4a23b185a45b9b79f8d5d9d249f2a (127.13.88.195:37279)
I20260923 19:46:22.801293 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:46:22.801820 30812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:40007
I20260923 19:46:22.812361 31001 heartbeater.cc:503] Master 127.13.88.254:38937 was elected leader, sending a full tablet report...
I20260923 19:46:22.818898 31003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.806029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33706 (local address 127.13.88.254:38937)
0923 19:46:22.806183 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.806187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.806718 (+ 531us) server_negotiation.cc:407] Connection header received
0923 19:46:22.806866 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.806869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.806935 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.807015 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:22.808469 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.809269 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.810513 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.810913 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.811002 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.813650 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:22.813655 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:22.813660 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:22.813695 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:22.816379 (+ 2684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:22.817066 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:22.817073 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:22.817077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:22.817209 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:22.817529 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:22.817532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:22.817534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:22.817829 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:22.818013 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.818360 (+ 347us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.818576 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:46:22.822707 30812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:46:22.829327 30812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:46:22.859031 31282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.840589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37279 (local address 127.0.0.1:50552)
0923 19:46:22.842123 (+ 1534us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:22.842171 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:22.842408 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:22.851774 (+ 9366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:22.851782 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:22.851814 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:22.852257 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.852276 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.854483 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.854491 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.856165 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.856177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.857939 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.857945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.858156 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.858194 (+ 38us) client_negotiation.cc:769] Sending connection context
0923 19:46:22.858382 (+ 188us) client_negotiation.cc:240] Negotiation successful
0923 19:46:22.858566 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1214,"mutex_wait_us":1,"thread_start_us":2172,"threads_started":1}
I20260923 19:46:22.859010 31281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.840920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.13.88.195:37279)
0923 19:46:22.851173 (+ 10253us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.851182 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.851212 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:46:22.851307 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.851315 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.851511 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.852521 (+ 1010us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:22.852796 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.854343 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.856323 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.857732 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.857865 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.858100 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.858528 (+ 428us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.858688 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10060,"thread_start_us":10178,"threads_started":1}
I20260923 19:46:22.859773 31280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.841300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58638)
0923 19:46:22.843035 (+ 1735us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:22.843052 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:22.843170 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:22.852003 (+ 8833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:22.852008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:22.852028 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:22.852508 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.852519 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.854546 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.854551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.856818 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.856834 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.858947 (+ 2113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.858954 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.859140 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.859171 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:46:22.859252 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 19:46:22.859375 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1608,"thread_start_us":920,"threads_started":1}
I20260923 19:46:22.860316 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.842016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58638 (local address 127.13.88.193:41003)
0923 19:46:22.850827 (+ 8811us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.850840 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.850876 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:46:22.851004 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.851013 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.851518 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.851745 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:22.852713 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.854343 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.857011 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.858461 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.858581 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.858794 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.859888 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.860035 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8595,"thread_start_us":8425,"threads_started":1}
I20260923 19:46:22.861197 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.843349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:43133 (local address 127.0.0.1:54638)
0923 19:46:22.853408 (+ 10059us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:22.853422 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:22.853556 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:22.854037 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:22.854042 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:22.854064 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:22.854406 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.854437 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.856349 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.856354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.858435 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.858449 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.860348 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.860354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.860673 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.860704 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:46:22.860800 (+ 96us) client_negotiation.cc:240] Negotiation successful
0923 19:46:22.860907 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9936,"thread_start_us":9801,"threads_started":1}
I20260923 19:46:22.861303 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.843452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54638 (local address 127.13.88.194:43133)
0923 19:46:22.852650 (+ 9198us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.852659 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.853527 (+ 868us) server_negotiation.cc:407] Connection header received
0923 19:46:22.853689 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.853694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.853868 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.854047 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:22.854592 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.856185 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.858611 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.860089 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.860211 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.860393 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.860860 (+ 467us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.861015 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9036,"thread_start_us":9269,"threads_started":1}
I20260923 19:46:22.863370 31203 tablet_service.cc:1467] Processing CreateTablet for tablet e6899f63738842e8876a3ffb28393618 (DEFAULT_TABLE table=test-table [id=a32fff49164545f9ba6ebb34edf03600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:22.863917 30936 tablet_service.cc:1467] Processing CreateTablet for tablet e6899f63738842e8876a3ffb28393618 (DEFAULT_TABLE table=test-table [id=a32fff49164545f9ba6ebb34edf03600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:22.864756 31203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6899f63738842e8876a3ffb28393618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:22.864619 31070 tablet_service.cc:1467] Processing CreateTablet for tablet e6899f63738842e8876a3ffb28393618 (DEFAULT_TABLE table=test-table [id=a32fff49164545f9ba6ebb34edf03600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:22.865325 30936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6899f63738842e8876a3ffb28393618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:22.865896 31070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6899f63738842e8876a3ffb28393618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:22.875768 31286 tablet_bootstrap.cc:492] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Bootstrap starting.
I20260923 19:46:22.878867 31286 tablet_bootstrap.cc:654] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:22.879833 31287 tablet_bootstrap.cc:492] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Bootstrap starting.
I20260923 19:46:22.880264 31286 log.cc:824] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:22.881352 31288 tablet_bootstrap.cc:492] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: Bootstrap starting.
I20260923 19:46:22.883886 31287 tablet_bootstrap.cc:654] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:22.884831 31288 tablet_bootstrap.cc:654] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:22.884820 31287 log.cc:824] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:22.884871 31286 tablet_bootstrap.cc:492] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: No bootstrap required, opened a new log
I20260923 19:46:22.885159 31286 ts_tablet_manager.cc:1397] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260923 19:46:22.886008 31288 log.cc:824] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:22.887727 31287 tablet_bootstrap.cc:492] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: No bootstrap required, opened a new log
I20260923 19:46:22.887993 31287 ts_tablet_manager.cc:1397] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:46:22.889204 31288 tablet_bootstrap.cc:492] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: No bootstrap required, opened a new log
I20260923 19:46:22.889454 31288 ts_tablet_manager.cc:1397] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260923 19:46:22.895445 31287 raft_consensus.cc:348] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.895817 31287 raft_consensus.cc:374] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:22.895949 31287 raft_consensus.cc:729] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1c968761af40cfaeff016368ad1398, State: Initialized, Role: FOLLOWER
I20260923 19:46:22.895758 31286 raft_consensus.cc:348] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.896186 31286 raft_consensus.cc:374] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:22.896314 31286 raft_consensus.cc:729] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e4a23b185a45b9b79f8d5d9d249f2a, State: Initialized, Role: FOLLOWER
I20260923 19:46:22.896620 31287 consensus_queue.cc:260] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.896925 31286 consensus_queue.cc:260] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.897778 31135 heartbeater.cc:503] Master 127.13.88.254:38937 was elected leader, sending a full tablet report...
I20260923 19:46:22.898449 31287 ts_tablet_manager.cc:1428] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260923 19:46:22.899734 31268 heartbeater.cc:503] Master 127.13.88.254:38937 was elected leader, sending a full tablet report...
I20260923 19:46:22.900357 31286 ts_tablet_manager.cc:1428] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Time spent starting tablet: real 0.015s user 0.010s sys 0.006s
I20260923 19:46:22.900307 31288 raft_consensus.cc:348] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.900813 31288 raft_consensus.cc:374] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:22.900923 31288 raft_consensus.cc:729] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963c579606c24ce28faa3dd40beb2138, State: Initialized, Role: FOLLOWER
I20260923 19:46:22.901557 31288 consensus_queue.cc:260] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.903257 31288 ts_tablet_manager.cc:1428] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260923 19:46:22.903662 31293 raft_consensus.cc:482] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:22.903944 31293 raft_consensus.cc:504] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.905974 31293 leader_election.cc:288] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc1c968761af40cfaeff016368ad1398 (127.13.88.194:43133), 963c579606c24ce28faa3dd40beb2138 (127.13.88.193:41003)
I20260923 19:46:22.912470 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.906209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:43133 (local address 127.13.88.195:42175)
0923 19:46:22.906429 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:22.906452 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:22.906560 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:22.907626 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:22.907632 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:22.907658 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:22.907854 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.907868 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.909025 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.909034 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.910533 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.910549 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.911899 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.911907 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.912105 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.912127 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:46:22.912192 (+ 65us) client_negotiation.cc:240] Negotiation successful
0923 19:46:22.912279 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260923 19:46:22.912628 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.906806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:42175 (local address 127.13.88.194:43133)
0923 19:46:22.907171 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.907176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.907193 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:46:22.907258 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.907265 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.907343 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.907443 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:22.908017 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.908881 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.910681 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.911751 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.911881 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.911961 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.912242 (+ 281us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.912371 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223}
I20260923 19:46:22.913543 31090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6899f63738842e8876a3ffb28393618" candidate_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c968761af40cfaeff016368ad1398" is_pre_election: true
I20260923 19:46:22.913992 31295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.906459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.13.88.195:59987)
0923 19:46:22.908223 (+ 1764us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:22.908243 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:22.908368 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:22.908681 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:22.908685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:22.908707 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:22.909168 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.909178 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.910348 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.910355 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.911849 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:22.911871 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.913360 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.913366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:22.913531 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.913553 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:46:22.913622 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 19:46:22.913699 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1645,"thread_start_us":1463,"threads_started":1}
I20260923 19:46:22.914036 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.906470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:59987 (local address 127.13.88.193:41003)
0923 19:46:22.906998 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.907006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.908323 (+ 1317us) server_negotiation.cc:407] Connection header received
0923 19:46:22.908500 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.908505 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.908565 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.908669 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:22.909414 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.910195 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.912045 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.913193 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.913367 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.913442 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.913681 (+ 239us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.913820 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399}
I20260923 19:46:22.914085 31090 raft_consensus.cc:2454] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10e4a23b185a45b9b79f8d5d9d249f2a in term 0.
I20260923 19:46:22.914908 31159 leader_election.cc:302] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10e4a23b185a45b9b79f8d5d9d249f2a, cc1c968761af40cfaeff016368ad1398; no voters:
I20260923 19:46:22.915066 30956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6899f63738842e8876a3ffb28393618" candidate_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963c579606c24ce28faa3dd40beb2138" is_pre_election: true
I20260923 19:46:22.915329 31293 raft_consensus.cc:2781] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:46:22.915472 31293 raft_consensus.cc:482] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:46:22.915580 31293 raft_consensus.cc:3037] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:22.915678 30956 raft_consensus.cc:2454] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10e4a23b185a45b9b79f8d5d9d249f2a in term 0.
I20260923 19:46:22.918136 31293 raft_consensus.cc:504] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.918701 31293 leader_election.cc:288] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [CANDIDATE]: Term 1 election: Requested vote from peers cc1c968761af40cfaeff016368ad1398 (127.13.88.194:43133), 963c579606c24ce28faa3dd40beb2138 (127.13.88.193:41003)
I20260923 19:46:22.919092 31090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6899f63738842e8876a3ffb28393618" candidate_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc1c968761af40cfaeff016368ad1398"
I20260923 19:46:22.919164 30956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6899f63738842e8876a3ffb28393618" candidate_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963c579606c24ce28faa3dd40beb2138"
I20260923 19:46:22.919327 31090 raft_consensus.cc:3037] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:22.919368 30956 raft_consensus.cc:3037] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:22.922565 30956 raft_consensus.cc:2454] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10e4a23b185a45b9b79f8d5d9d249f2a in term 1.
I20260923 19:46:22.922564 31090 raft_consensus.cc:2454] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10e4a23b185a45b9b79f8d5d9d249f2a in term 1.
I20260923 19:46:22.922972 31157 leader_election.cc:302] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10e4a23b185a45b9b79f8d5d9d249f2a, 963c579606c24ce28faa3dd40beb2138; no voters:
I20260923 19:46:22.923440 31293 raft_consensus.cc:2781] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:22.923928 31293 raft_consensus.cc:686] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 1 LEADER]: Becoming Leader. State: Replica: 10e4a23b185a45b9b79f8d5d9d249f2a, State: Running, Role: LEADER
I20260923 19:46:22.924474 31293 consensus_queue.cc:237] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } }
I20260923 19:46:22.929104 30812 catalog_manager.cc:5495] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10e4a23b185a45b9b79f8d5d9d249f2a (127.13.88.195). New cstate: current_term: 1 leader_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e4a23b185a45b9b79f8d5d9d249f2a" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 } health_report { overall_health: UNKNOWN } } }
I20260923 19:46:22.954743 31281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:22.949710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50564 (local address 127.13.88.195:37279)
0923 19:46:22.949882 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:22.949886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:22.949975 (+ 89us) server_negotiation.cc:407] Connection header received
0923 19:46:22.950112 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:22.950115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:22.950188 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:22.950317 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:46:22.950609 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.951437 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.952779 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:22.953153 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:22.953265 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:22.953808 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:46:22.954298 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:46:22.954422 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:22.954486 (+ 64us) server_negotiation.cc:299] Negotiation successful
0923 19:46:22.954549 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 19:46:22.962730 30956 raft_consensus.cc:1261] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 1 FOLLOWER]: Refusing update from remote peer 10e4a23b185a45b9b79f8d5d9d249f2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:22.962740 31090 raft_consensus.cc:1261] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 1 FOLLOWER]: Refusing update from remote peer 10e4a23b185a45b9b79f8d5d9d249f2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:22.963692 31296 consensus_queue.cc:1035] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "963c579606c24ce28faa3dd40beb2138" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 41003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:22.964027 31293 consensus_queue.cc:1035] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1c968761af40cfaeff016368ad1398" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:22.973694 31299 mvcc.cc:205] Tried to move back new op lower bound from 7332629639006044160 to 7332629638862397440. Current Snapshot: MvccSnapshot[applied={T|T < 7332629639006044160}]
I20260923 19:46:22.974000 31300 mvcc.cc:205] Tried to move back new op lower bound from 7332629639006044160 to 7332629638862397440. Current Snapshot: MvccSnapshot[applied={T|T < 7332629639006044160}]
I20260923 19:46:22.991832 30811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:22.992120 30811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:22.995540 30811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P df3219ead70d4eb9b9d66f14aec608eb: Sending DeleteTablet for 3 replicas of tablet e6899f63738842e8876a3ffb28393618
I20260923 19:46:22.996630 30936 tablet_service.cc:1514] Processing DeleteTablet for tablet e6899f63738842e8876a3ffb28393618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:22 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:58638
I20260923 19:46:22.996933 31203 tablet_service.cc:1514] Processing DeleteTablet for tablet e6899f63738842e8876a3ffb28393618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:22 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:50552
I20260923 19:46:22.996937 31070 tablet_service.cc:1514] Processing DeleteTablet for tablet e6899f63738842e8876a3ffb28393618 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:22 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:54638
I20260923 19:46:23.000667 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 30873
I20260923 19:46:23.011634 31310 tablet_replica.cc:330] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: stopping tablet replica
I20260923 19:46:23.012387 31310 raft_consensus.cc:2229] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:46:23.013343 31310 raft_consensus.cc:2258] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:23.014643 31311 tablet_replica.cc:330] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: stopping tablet replica
I20260923 19:46:23.015159 31311 raft_consensus.cc:2229] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:23.015684 31311 raft_consensus.cc:2258] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:23.017184 31310 ts_tablet_manager.cc:1905] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:23.017637 31311 ts_tablet_manager.cc:1905] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:23.021489 31309 tablet_replica.cc:330] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: stopping tablet replica
I20260923 19:46:23.025208 31310 ts_tablet_manager.cc:1918] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:23.025377 31310 log.cc:1196] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/e6899f63738842e8876a3ffb28393618
I20260923 19:46:23.025893 31310 ts_tablet_manager.cc:1939] T e6899f63738842e8876a3ffb28393618 P 10e4a23b185a45b9b79f8d5d9d249f2a: Deleting consensus metadata
I20260923 19:46:23.025827 31309 raft_consensus.cc:2229] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:23.026162 31311 ts_tablet_manager.cc:1918] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:23.026319 31311 log.cc:1196] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/e6899f63738842e8876a3ffb28393618
I20260923 19:46:23.026631 31309 raft_consensus.cc:2258] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:23.026894 31311 ts_tablet_manager.cc:1939] T e6899f63738842e8876a3ffb28393618 P cc1c968761af40cfaeff016368ad1398: Deleting consensus metadata
I20260923 19:46:23.027860 30799 catalog_manager.cc:4841] TS 10e4a23b185a45b9b79f8d5d9d249f2a (127.13.88.195:37279): tablet e6899f63738842e8876a3ffb28393618 (table test-table [id=a32fff49164545f9ba6ebb34edf03600]) successfully deleted
I20260923 19:46:23.029038 31309 ts_tablet_manager.cc:1905] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: Deleting tablet data with delete state TABLET_DATA_DELETED
Sep 23 19:46:23 dist-test-slave-xg7f krb5kdc[30767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:46:23.037055 30799 catalog_manager.cc:4841] TS cc1c968761af40cfaeff016368ad1398 (127.13.88.194:43133): tablet e6899f63738842e8876a3ffb28393618 (table test-table [id=a32fff49164545f9ba6ebb34edf03600]) successfully deleted
I20260923 19:46:23.037464 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.001884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58640 (local address 127.13.88.193:41003)
0923 19:46:23.002105 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:23.002115 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:23.019909 (+ 17794us) server_negotiation.cc:407] Connection header received
0923 19:46:23.020144 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:23.020149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:23.020246 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:23.020347 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:23.022272 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:23.023475 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:23.025460 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:23.026231 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:23.026327 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:23.031170 (+ 4843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:23.031185 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:23.031208 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:23.031242 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:23.034303 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:23.035157 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:23.035166 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:23.035171 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:23.035309 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:23.035693 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:23.035701 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:23.035704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:23.036071 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:23.036366 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:23.036729 (+ 363us) server_negotiation.cc:299] Negotiation successful
0923 19:46:23.036964 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:46:23.038112 30996 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:23.128799 31309 ts_tablet_manager.cc:1918] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:23.129096 31309 log.cc:1196] T e6899f63738842e8876a3ffb28393618 P 963c579606c24ce28faa3dd40beb2138: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/e6899f63738842e8876a3ffb28393618
I20260923 19:46:23.129485 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 30873
I20260923 19:46:23.147490 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31007
W20260923 19:46:23.147614 30797 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.88.193:41003 (error 108)
I20260923 19:46:23.149544 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.149131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58644)
0923 19:46:23.149294 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.149403 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:46:23.150027 30797 catalog_manager.cc:4584] TS 963c579606c24ce28faa3dd40beb2138 (127.13.88.193:41003): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e6899f63738842e8876a3ffb28393618: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Sep 23 19:46:23 dist-test-slave-xg7f krb5kdc[30767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:46:23.165657 31285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.148605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54654 (local address 127.13.88.194:43133)
0923 19:46:23.148804 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:23.148810 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:23.148862 (+ 52us) server_negotiation.cc:407] Connection header received
0923 19:46:23.149127 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:23.149135 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:23.149224 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:23.149329 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:23.151186 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:23.151909 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:23.153763 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:23.154148 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:23.154235 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:23.159344 (+ 5109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:23.159369 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:23.159387 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:23.159438 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:23.162871 (+ 3433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:23.163623 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:23.163633 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:23.163636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:23.163779 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:23.164128 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:23.164133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:23.164137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:23.164601 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:23.164885 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:23.165087 (+ 202us) server_negotiation.cc:299] Negotiation successful
0923 19:46:23.165295 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:46:23.166313 31130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:23.203713 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.203279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58646)
0923 19:46:23.203465 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.203564 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260923 19:46:23.204754 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.204435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58652)
0923 19:46:23.204576 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.204645 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 19:46:23.265632 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.265055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58666)
0923 19:46:23.265324 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.265436 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260923 19:46:23.266778 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.266375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58668)
0923 19:46:23.266548 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.266636 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 19:46:23.284317 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31007
I20260923 19:46:23.301110 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31140
Sep 23 19:46:23 dist-test-slave-xg7f krb5kdc[30767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:46:23.317713 31281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.301978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.13.88.195:37279)
0923 19:46:23.302156 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:23.302162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:23.302183 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:46:23.302348 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:23.302357 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:23.302423 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:23.302542 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:23.303972 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:23.304796 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:23.306075 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:23.306579 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:23.306716 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:23.311497 (+ 4781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:23.311511 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:23.311526 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:23.311562 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:23.314535 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:23.315531 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:23.315543 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:23.315547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:23.315756 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:23.316133 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:23.316138 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:23.316141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:23.316506 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:23.316833 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:23.317119 (+ 286us) server_negotiation.cc:299] Negotiation successful
0923 19:46:23.317346 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:46:23.318478 31263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:23.347561 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.347014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58682)
0923 19:46:23.347291 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.347390 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260923 19:46:23.348640 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.348216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58692)
0923 19:46:23.348464 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.348532 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260923 19:46:23.439073 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31140
I20260923 19:46:23.458292 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 30780
I20260923 19:46:23.459581 30842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:23.569934 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:23.569314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:41003 (local address 127.0.0.1:58698)
0923 19:46:23.569516 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:23.569648 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:41003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 19:46:23.570271 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 30780
2026-09-23T19:46:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4149 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-23T19:46:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:23Z Disabled control of system clock
I20260923 19:46:23.643867 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36777
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:36777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:46:23.966814 31321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:23.967079 31321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:23.967262 31321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:23.974949 31321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:23.975056 31321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:23.975131 31321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:23.975207 31321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:23.975265 31321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:23.984187 31321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:36777
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:36777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:23.985463 31321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:23.987337 31321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:24.000061 31329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:24.000137 31326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:24.000109 31327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:24.001159 31321 server_base.cc:1034] running on GCE node
I20260923 19:46:24.001891 31321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:24.003253 31321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:24.004474 31321 hybrid_clock.cc:648] HybridClock initialized: now 1790192784004410 us; error 55 us; skew 500 ppm
I20260923 19:46:24.004853 31321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:24.010965 31321 webserver.cc:460] Webserver started at http://127.13.88.254:41813/ using document root <none> and password file <none>
I20260923 19:46:24.011719 31321 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:24.011855 31321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:24.012185 31321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:24.015074 31321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "b57d2dd025704e618ec79d70b73797a8"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "5ee30f2d03fbf211acd800673c6d8844"
server_key_iv: "df9280cc5c557e0706c385f70c73720b"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.015959 31321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "b57d2dd025704e618ec79d70b73797a8"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "5ee30f2d03fbf211acd800673c6d8844"
server_key_iv: "df9280cc5c557e0706c385f70c73720b"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.021155 31321 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:46:24.024576 31335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:24.025892 31321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:46:24.026088 31321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "b57d2dd025704e618ec79d70b73797a8"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "5ee30f2d03fbf211acd800673c6d8844"
server_key_iv: "df9280cc5c557e0706c385f70c73720b"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.026345 31321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:24.047664 31321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:24.048579 31321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:24.048889 31321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:24.067905 31321 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:36777
I20260923 19:46:24.067924 31386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:36777 every 8 connection(s)
I20260923 19:46:24.069221 31321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:24.072898 31387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:24.075084 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31321
I20260923 19:46:24.075310 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:24.075708 13667 external_mini_cluster.cc:1428] Setting key 74c9250729d1d83b86f22a4d1647a26e
I20260923 19:46:24.084440 31387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8: Bootstrap starting.
I20260923 19:46:24.087518 31387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:24.088646 31387 log.cc:824] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:24.088922 31390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:24.077530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59722 (local address 127.13.88.254:36777)
0923 19:46:24.078476 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:24.078487 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:24.078531 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:46:24.080143 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:24.080164 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:24.080578 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:24.080960 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:24.081527 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:24.083325 (+ 1798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:24.084675 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:24.085314 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:24.085500 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:24.086654 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:24.086661 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:24.086674 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:24.087242 (+ 568us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:24.087332 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:24.087352 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:24.087493 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:24.087712 (+ 219us) server_negotiation.cc:299] Negotiation successful
0923 19:46:24.088003 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":325,"threads_started":1}
I20260923 19:46:24.091742 31387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8: No bootstrap required, opened a new log
I20260923 19:46:24.099159 31387 raft_consensus.cc:348] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b57d2dd025704e618ec79d70b73797a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36777 } }
I20260923 19:46:24.099547 31387 raft_consensus.cc:374] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:24.099653 31387 raft_consensus.cc:729] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b57d2dd025704e618ec79d70b73797a8, State: Initialized, Role: FOLLOWER
I20260923 19:46:24.100260 31387 consensus_queue.cc:260] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b57d2dd025704e618ec79d70b73797a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36777 } }
I20260923 19:46:24.100498 31387 raft_consensus.cc:388] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:24.100646 31387 raft_consensus.cc:482] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:24.100823 31387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:24.102900 31387 raft_consensus.cc:504] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b57d2dd025704e618ec79d70b73797a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36777 } }
I20260923 19:46:24.103398 31387 leader_election.cc:302] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b57d2dd025704e618ec79d70b73797a8; no voters:
I20260923 19:46:24.103927 31387 leader_election.cc:288] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:24.104095 31392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:24.104805 31392 raft_consensus.cc:686] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [term 1 LEADER]: Becoming Leader. State: Replica: b57d2dd025704e618ec79d70b73797a8, State: Running, Role: LEADER
I20260923 19:46:24.105322 31392 consensus_queue.cc:237] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b57d2dd025704e618ec79d70b73797a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36777 } }
I20260923 19:46:24.106119 31387 sys_catalog.cc:564] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:24.108100 31393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b57d2dd025704e618ec79d70b73797a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b57d2dd025704e618ec79d70b73797a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36777 } } }
I20260923 19:46:24.108556 31393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:24.108124 31394 sys_catalog.cc:455] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b57d2dd025704e618ec79d70b73797a8. Latest consensus state: current_term: 1 leader_uuid: "b57d2dd025704e618ec79d70b73797a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b57d2dd025704e618ec79d70b73797a8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 36777 } } }
I20260923 19:46:24.109938 31394 sys_catalog.cc:458] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:24.110478 31398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:24.115854 31398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:24.123742 31398 catalog_manager.cc:1347] Generated new cluster ID: edd8adf71a174a47b3688dad8859119c
I20260923 19:46:24.123862 31398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:24.145560 31398 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:24.146817 31398 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:24.155293 31398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8: Generated new TSK 0
I20260923 19:46:24.156116 31398 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:24.161180 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36777
--builtin_ntp_servers=127.13.88.212:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:46:24.483994 31411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:24.484392 31411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:24.484594 31411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:24.491791 31411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:24.491885 31411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:24.492084 31411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:46:24.500993 31411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:24.502331 31411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:24.504113 31411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:24.517264 31416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:24.517194 31419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:24.517236 31417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:24.518515 31411 server_base.cc:1034] running on GCE node
I20260923 19:46:24.519088 31411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:24.520080 31411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:24.521275 31411 hybrid_clock.cc:648] HybridClock initialized: now 1790192784521234 us; error 34 us; skew 500 ppm
I20260923 19:46:24.521580 31411 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:24.523793 31411 webserver.cc:460] Webserver started at http://127.13.88.193:46201/ using document root <none> and password file <none>
I20260923 19:46:24.524444 31411 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:24.524551 31411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:24.524880 31411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:24.527694 31411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "4affffa1f0414a6186d1732c9249d955"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "8a2e461e0413d17f3a025246d93736c2"
server_key_iv: "d72846ee58f87dc4efd3253f83584dc1"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.528491 31411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "4affffa1f0414a6186d1732c9249d955"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "8a2e461e0413d17f3a025246d93736c2"
server_key_iv: "d72846ee58f87dc4efd3253f83584dc1"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.533484 31411 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260923 19:46:24.537081 31425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:24.538341 31411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:46:24.538507 31411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "4affffa1f0414a6186d1732c9249d955"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "8a2e461e0413d17f3a025246d93736c2"
server_key_iv: "d72846ee58f87dc4efd3253f83584dc1"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.538738 31411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:24.556131 31411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:24.556927 31411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:24.557221 31411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:24.558156 31411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:24.559636 31411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:24.559756 31411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:24.559886 31411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:24.559979 31411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:24.592338 31411 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:44527
I20260923 19:46:24.592414 31537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:44527 every 8 connection(s)
I20260923 19:46:24.593700 31411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:46:24.593971 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31411
I20260923 19:46:24.594157 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:46:24.594755 13667 external_mini_cluster.cc:1428] Setting key a0046c342e39fb551028786cf31d1ce8
I20260923 19:46:24.597800 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36777
--builtin_ntp_servers=127.13.88.212:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:46:24.609378 31540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:24.597061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:38117 (local address 127.13.88.254:36777)
0923 19:46:24.597525 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:24.597532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:24.599003 (+ 1471us) server_negotiation.cc:407] Connection header received
0923 19:46:24.601752 (+ 2749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:24.601757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:24.601821 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:24.601915 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:24.603287 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:24.603979 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:24.606502 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:24.607007 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:24.607158 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:24.608524 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:24.608530 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:24.608535 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:24.608561 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:24.608607 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:24.608619 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:24.608715 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:24.608942 (+ 227us) server_negotiation.cc:299] Negotiation successful
0923 19:46:24.609035 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":227,"threads_started":1}
I20260923 19:46:24.610491 31541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:24.597730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36777 (local address 127.13.88.193:38117)
0923 19:46:24.598828 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:24.598881 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:24.601487 (+ 2606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:24.602183 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:24.602195 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:24.602313 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:24.603127 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:24.603156 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:24.604135 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:24.604143 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:24.606337 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:24.606354 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:24.607268 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:24.607275 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:24.607519 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:24.608219 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:24.608222 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:24.608260 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:24.608339 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:24.608712 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:24.608724 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:24.608734 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 19:46:24.608910 (+ 176us) client_negotiation.cc:240] Negotiation successful
0923 19:46:24.609295 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":319,"threads_started":1}
I20260923 19:46:24.612195 31538 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36777
I20260923 19:46:24.612511 31538 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:24.613421 31538 heartbeater.cc:511] Master 127.13.88.254:36777 requested a full tablet report, sending...
I20260923 19:46:24.615576 31352 ts_manager.cc:194] Registered new tserver with Master: 4affffa1f0414a6186d1732c9249d955 (127.13.88.193:44527)
I20260923 19:46:24.617093 31352 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.193:38117
W20260923 19:46:24.919263 31542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:24.919589 31542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:24.919759 31542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:24.926877 31542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:24.927001 31542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:24.927232 31542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:46:24.936098 31542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:24.937371 31542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:24.939147 31542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:24.952029 31547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:24.952059 31548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:24.952123 31550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:24.953024 31542 server_base.cc:1034] running on GCE node
I20260923 19:46:24.953608 31542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:24.954537 31542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:24.955758 31542 hybrid_clock.cc:648] HybridClock initialized: now 1790192784955721 us; error 48 us; skew 500 ppm
I20260923 19:46:24.956076 31542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:24.958179 31542 webserver.cc:460] Webserver started at http://127.13.88.194:45215/ using document root <none> and password file <none>
I20260923 19:46:24.958856 31542 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:24.958995 31542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:24.959347 31542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:24.962409 31542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "2891306ee01a4cb48202d9476f99e0c6"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "b40792614b1c1dc18a533a5dbbf67afe"
server_key_iv: "5840304bd5cd56edced02c6b7570cd67"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.963402 31542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "2891306ee01a4cb48202d9476f99e0c6"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "b40792614b1c1dc18a533a5dbbf67afe"
server_key_iv: "5840304bd5cd56edced02c6b7570cd67"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.968209 31542 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 19:46:24.971565 31556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:24.972824 31542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:46:24.973001 31542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "2891306ee01a4cb48202d9476f99e0c6"
format_stamp: "Formatted at 2026-09-23 19:46:24 on dist-test-slave-xg7f"
server_key: "b40792614b1c1dc18a533a5dbbf67afe"
server_key_iv: "5840304bd5cd56edced02c6b7570cd67"
server_key_version: "encryptionkey@0"
I20260923 19:46:24.973203 31542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:24.984936 31542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:24.985656 31542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:24.985941 31542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:24.986833 31542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:24.988265 31542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:24.988384 31542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:24.988518 31542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:24.988606 31542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:25.022200 31542 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:45041
I20260923 19:46:25.022254 31668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:45041 every 8 connection(s)
I20260923 19:46:25.023613 31542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:46:25.025048 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31542
I20260923 19:46:25.025233 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:46:25.025786 13667 external_mini_cluster.cc:1428] Setting key 9e2db84b613637eba079107791dc50d4
I20260923 19:46:25.028743 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36777
--builtin_ntp_servers=127.13.88.212:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:46:25.036613 31540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.026362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:40259 (local address 127.13.88.254:36777)
0923 19:46:25.026599 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.026604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.028237 (+ 1633us) server_negotiation.cc:407] Connection header received
0923 19:46:25.030140 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.030145 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.030226 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.030336 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:25.031554 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.032258 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.033784 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.034224 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.034362 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.035749 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:25.035753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:25.035757 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:25.035773 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:25.035807 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:25.035818 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:25.035919 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.036182 (+ 263us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.036257 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:46:25.037874 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.026993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36777 (local address 127.13.88.194:40259)
0923 19:46:25.028095 (+ 1102us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.028136 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:25.029870 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:25.030557 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:25.030564 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:25.030646 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:25.031399 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.031417 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.032409 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.032415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.033646 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.033657 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.034448 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.034455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.034684 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.035418 (+ 734us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:25.035424 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:25.035474 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:25.035572 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:25.035942 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:25.035955 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:25.035964 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 19:46:25.036155 (+ 191us) client_negotiation.cc:240] Negotiation successful
0923 19:46:25.036548 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":333,"threads_started":1}
I20260923 19:46:25.039220 31669 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36777
I20260923 19:46:25.039506 31669 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:25.040195 31669 heartbeater.cc:511] Master 127.13.88.254:36777 requested a full tablet report, sending...
I20260923 19:46:25.041579 31352 ts_manager.cc:194] Registered new tserver with Master: 2891306ee01a4cb48202d9476f99e0c6 (127.13.88.194:45041)
I20260923 19:46:25.042472 31352 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.194:40259
W20260923 19:46:25.347877 31672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:25.348186 31672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:25.348357 31672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:25.355273 31672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:25.355406 31672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:25.355587 31672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:46:25.364640 31672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:36777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:25.365957 31672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:25.367822 31672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:25.380882 31677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:25.380823 31678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:25.380846 31680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:25.381605 31672 server_base.cc:1034] running on GCE node
I20260923 19:46:25.382184 31672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:25.383144 31672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:25.384397 31672 hybrid_clock.cc:648] HybridClock initialized: now 1790192785384298 us; error 89 us; skew 500 ppm
I20260923 19:46:25.384709 31672 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:25.386900 31672 webserver.cc:460] Webserver started at http://127.13.88.195:33693/ using document root <none> and password file <none>
I20260923 19:46:25.387663 31672 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:25.387786 31672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:25.388113 31672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:25.390874 31672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e"
format_stamp: "Formatted at 2026-09-23 19:46:25 on dist-test-slave-xg7f"
server_key: "025a1bd21823511d424a2d9a852b9e24"
server_key_iv: "3c83fde928b824b08de6c5d1756d3c51"
server_key_version: "encryptionkey@0"
I20260923 19:46:25.391723 31672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e"
format_stamp: "Formatted at 2026-09-23 19:46:25 on dist-test-slave-xg7f"
server_key: "025a1bd21823511d424a2d9a852b9e24"
server_key_iv: "3c83fde928b824b08de6c5d1756d3c51"
server_key_version: "encryptionkey@0"
I20260923 19:46:25.396564 31672 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260923 19:46:25.399850 31686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:25.401093 31672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:46:25.401288 31672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e"
format_stamp: "Formatted at 2026-09-23 19:46:25 on dist-test-slave-xg7f"
server_key: "025a1bd21823511d424a2d9a852b9e24"
server_key_iv: "3c83fde928b824b08de6c5d1756d3c51"
server_key_version: "encryptionkey@0"
I20260923 19:46:25.401496 31672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:25.417584 31672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:25.418334 31672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:25.418656 31672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:25.419605 31672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:25.420961 31672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:25.421080 31672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:25.421236 31672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:25.421326 31672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:25.453445 31672 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:39093
I20260923 19:46:25.453529 31798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:39093 every 8 connection(s)
I20260923 19:46:25.454793 31672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:46:25.463029 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31672
I20260923 19:46:25.463254 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:46:25.463804 13667 external_mini_cluster.cc:1428] Setting key 287031f832097b37686007b0af01b40e
I20260923 19:46:25.467159 31540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.457337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:43137 (local address 127.13.88.254:36777)
0923 19:46:25.457524 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.457528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.458814 (+ 1286us) server_negotiation.cc:407] Connection header received
0923 19:46:25.460631 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.460637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.460727 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.460836 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:25.461845 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.462574 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.464430 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.464949 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.465080 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.466341 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:25.466348 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:25.466352 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:25.466390 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:25.466421 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:25.466432 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:25.466531 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.466737 (+ 206us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.466829 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:46:25.468087 31801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.457785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:36777 (local address 127.13.88.195:43137)
0923 19:46:25.458656 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.458696 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:25.460370 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:25.461065 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:25.461073 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:25.461154 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:25.461681 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.461696 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.462724 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.462731 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.464273 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.464284 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.465169 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.465175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.465399 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.466055 (+ 656us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:25.466058 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:25.466093 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:25.466166 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:25.466530 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:25.466541 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:25.466551 (+ 10us) client_negotiation.cc:769] Sending connection context
0923 19:46:25.466728 (+ 177us) client_negotiation.cc:240] Negotiation successful
0923 19:46:25.467127 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":259,"threads_started":1}
I20260923 19:46:25.469309 31799 heartbeater.cc:347] Connected to a master server at 127.13.88.254:36777
I20260923 19:46:25.469552 31799 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:25.470184 31799 heartbeater.cc:511] Master 127.13.88.254:36777 requested a full tablet report, sending...
I20260923 19:46:25.471463 31352 ts_manager.cc:194] Registered new tserver with Master: 7e6be6ae3fc8449d9b78fb07221b5f1e (127.13.88.195:39093)
I20260923 19:46:25.472216 31352 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.195:43137
I20260923 19:46:25.478413 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:46:25.487399 31540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.482207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59734 (local address 127.13.88.254:36777)
0923 19:46:25.482388 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.482392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.482880 (+ 488us) server_negotiation.cc:407] Connection header received
0923 19:46:25.483006 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.483010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.483071 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.483193 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:25.483642 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.484273 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.485516 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.485862 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.485944 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.486818 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:25.486823 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:25.486826 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:25.486841 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:25.486870 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:25.486880 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:25.486945 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.487061 (+ 116us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.487186 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:46:25.490875 31352 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59734:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:46:25.497596 31352 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:46:25.526225 31811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.508870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:39093 (local address 127.0.0.1:45558)
0923 19:46:25.516361 (+ 7491us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.516406 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:25.516546 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:25.517734 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:25.517741 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:25.517770 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:25.518220 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.518237 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.520793 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.520801 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.523596 (+ 2795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.523607 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.525254 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.525261 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.525460 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.525530 (+ 70us) client_negotiation.cc:769] Sending connection context
0923 19:46:25.525671 (+ 141us) client_negotiation.cc:240] Negotiation successful
0923 19:46:25.525836 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7311,"mutex_wait_us":24,"thread_start_us":7187,"threads_started":1}
I20260923 19:46:25.527246 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.509131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45558 (local address 127.13.88.195:39093)
0923 19:46:25.510437 (+ 1306us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.510448 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.516510 (+ 6062us) server_negotiation.cc:407] Connection header received
0923 19:46:25.516959 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.516967 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.517238 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.517426 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:25.518522 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.520594 (+ 2072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.523780 (+ 3186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.525062 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.525187 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.525594 (+ 407us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.526659 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.526849 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1084,"thread_start_us":901,"threads_started":1}
I20260923 19:46:25.527597 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.509330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36748 (local address 127.13.88.193:44527)
0923 19:46:25.510040 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.510051 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.517257 (+ 7206us) server_negotiation.cc:407] Connection header received
0923 19:46:25.517389 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.517399 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.517687 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.517887 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:25.518950 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.520990 (+ 2040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.524133 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.525522 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.525668 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.525921 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.527062 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.527246 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":319,"threads_started":1}
I20260923 19:46:25.526961 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.509523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36748)
0923 19:46:25.516984 (+ 7461us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.517004 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:25.517128 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:25.518196 (+ 1068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:25.518204 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:25.518239 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:25.518729 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.518743 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.521194 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.521202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.523958 (+ 2756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.523969 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.526195 (+ 2226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.526200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.526425 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.526455 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 19:46:25.526537 (+ 82us) client_negotiation.cc:240] Negotiation successful
0923 19:46:25.526692 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7306,"mutex_wait_us":29,"thread_start_us":7213,"threads_started":1}
I20260923 19:46:25.531279 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.517863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:45041 (local address 127.0.0.1:33092)
0923 19:46:25.523641 (+ 5778us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.523661 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:25.523762 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:25.524386 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:25.524390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:25.524411 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:25.524752 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.524760 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.526522 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.526527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.528634 (+ 2107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.528646 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.530487 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.530493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.530704 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.530748 (+ 44us) client_negotiation.cc:769] Sending connection context
0923 19:46:25.530840 (+ 92us) client_negotiation.cc:240] Negotiation successful
0923 19:46:25.530972 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5650,"thread_start_us":5512,"threads_started":1}
I20260923 19:46:25.531461 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.517132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33092 (local address 127.13.88.194:45041)
0923 19:46:25.523291 (+ 6159us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.523298 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.523882 (+ 584us) server_negotiation.cc:407] Connection header received
0923 19:46:25.523987 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.523996 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.524203 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.524385 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:25.524910 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.526356 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.528814 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.530257 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.530403 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.530655 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.530905 (+ 250us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.531065 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6011,"thread_start_us":5879,"threads_started":1}
I20260923 19:46:25.531582 31473 tablet_service.cc:1467] Processing CreateTablet for tablet c4901dfa5be741be8e4736bab3a91b46 (DEFAULT_TABLE table=test-table [id=b2d4086fbe9a4bffbdb0b4759acae188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:25.531424 31734 tablet_service.cc:1467] Processing CreateTablet for tablet c4901dfa5be741be8e4736bab3a91b46 (DEFAULT_TABLE table=test-table [id=b2d4086fbe9a4bffbdb0b4759acae188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:25.532761 31473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4901dfa5be741be8e4736bab3a91b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:25.532948 31734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4901dfa5be741be8e4736bab3a91b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:25.542347 31604 tablet_service.cc:1467] Processing CreateTablet for tablet c4901dfa5be741be8e4736bab3a91b46 (DEFAULT_TABLE table=test-table [id=b2d4086fbe9a4bffbdb0b4759acae188]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:25.543746 31604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4901dfa5be741be8e4736bab3a91b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:25.543902 31817 tablet_bootstrap.cc:492] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Bootstrap starting.
I20260923 19:46:25.546969 31817 tablet_bootstrap.cc:654] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:25.547817 31818 tablet_bootstrap.cc:492] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: Bootstrap starting.
I20260923 19:46:25.549521 31817 log.cc:824] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:25.551326 31818 tablet_bootstrap.cc:654] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:25.552539 31818 log.cc:824] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:25.552785 31817 tablet_bootstrap.cc:492] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: No bootstrap required, opened a new log
I20260923 19:46:25.553077 31817 ts_tablet_manager.cc:1397] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:46:25.555792 31818 tablet_bootstrap.cc:492] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: No bootstrap required, opened a new log
I20260923 19:46:25.556072 31818 ts_tablet_manager.cc:1397] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260923 19:46:25.557431 31821 tablet_bootstrap.cc:492] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Bootstrap starting.
I20260923 19:46:25.561496 31821 tablet_bootstrap.cc:654] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:25.562754 31821 log.cc:824] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:25.564157 31817 raft_consensus.cc:348] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.564548 31817 raft_consensus.cc:374] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:25.564371 31818 raft_consensus.cc:348] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.564673 31817 raft_consensus.cc:729] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e6be6ae3fc8449d9b78fb07221b5f1e, State: Initialized, Role: FOLLOWER
I20260923 19:46:25.564782 31818 raft_consensus.cc:374] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:25.564884 31818 raft_consensus.cc:729] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4affffa1f0414a6186d1732c9249d955, State: Initialized, Role: FOLLOWER
I20260923 19:46:25.565447 31817 consensus_queue.cc:260] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.565472 31818 consensus_queue.cc:260] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.565908 31821 tablet_bootstrap.cc:492] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: No bootstrap required, opened a new log
I20260923 19:46:25.566303 31821 ts_tablet_manager.cc:1397] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260923 19:46:25.566514 31799 heartbeater.cc:503] Master 127.13.88.254:36777 was elected leader, sending a full tablet report...
I20260923 19:46:25.567219 31817 ts_tablet_manager.cc:1428] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
I20260923 19:46:25.568480 31538 heartbeater.cc:503] Master 127.13.88.254:36777 was elected leader, sending a full tablet report...
I20260923 19:46:25.568681 31818 ts_tablet_manager.cc:1428] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260923 19:46:25.575980 31821 raft_consensus.cc:348] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.576346 31821 raft_consensus.cc:374] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:25.576452 31821 raft_consensus.cc:729] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2891306ee01a4cb48202d9476f99e0c6, State: Initialized, Role: FOLLOWER
I20260923 19:46:25.576996 31821 consensus_queue.cc:260] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.577711 31824 raft_consensus.cc:482] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:25.577982 31824 raft_consensus.cc:504] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.578127 31669 heartbeater.cc:503] Master 127.13.88.254:36777 was elected leader, sending a full tablet report...
I20260923 19:46:25.578588 31821 ts_tablet_manager.cc:1428] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Time spent starting tablet: real 0.012s user 0.005s sys 0.005s
I20260923 19:46:25.579705 31824 leader_election.cc:288] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e6be6ae3fc8449d9b78fb07221b5f1e (127.13.88.195:39093), 2891306ee01a4cb48202d9476f99e0c6 (127.13.88.194:45041)
I20260923 19:46:25.586826 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.580086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:34273 (local address 127.13.88.195:39093)
0923 19:46:25.580342 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.580352 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.580910 (+ 558us) server_negotiation.cc:407] Connection header received
0923 19:46:25.581133 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.581137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.581206 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.581265 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:25.582117 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.583160 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.585141 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.585899 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.586058 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.586134 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.586471 (+ 337us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.586591 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:46:25.586958 31827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.580821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:45041 (local address 127.13.88.193:54089)
0923 19:46:25.581366 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.581382 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:25.581536 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:25.581872 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:25.581880 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:25.581907 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:25.582226 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.582234 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.583264 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.583270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.584934 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.584946 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.586093 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.586099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.586282 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.586327 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 19:46:25.586427 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 19:46:25.586552 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":102,"thread_start_us":435,"threads_started":1}
I20260923 19:46:25.587399 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.581120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:54089 (local address 127.13.88.194:45041)
0923 19:46:25.581281 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.581287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.581450 (+ 163us) server_negotiation.cc:407] Connection header received
0923 19:46:25.581666 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.581671 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.581737 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.581853 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:25.582375 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.583074 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.585129 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.585871 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.586037 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.586115 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.586463 (+ 348us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.586582 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:46:25.586984 31826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.580020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:39093 (local address 127.13.88.193:34273)
0923 19:46:25.580784 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.580804 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:25.580955 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:25.581471 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:25.581475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:25.581502 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:25.581923 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.581937 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.583290 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.583295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.584940 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:25.584951 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.586111 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.586117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:25.586314 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.586341 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 19:46:25.586446 (+ 105us) client_negotiation.cc:240] Negotiation successful
0923 19:46:25.586565 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":126,"thread_start_us":348,"threads_started":1}
I20260923 19:46:25.588184 31624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4901dfa5be741be8e4736bab3a91b46" candidate_uuid: "4affffa1f0414a6186d1732c9249d955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2891306ee01a4cb48202d9476f99e0c6" is_pre_election: true
I20260923 19:46:25.588626 31624 raft_consensus.cc:2454] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4affffa1f0414a6186d1732c9249d955 in term 0.
I20260923 19:46:25.589213 31428 leader_election.cc:302] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2891306ee01a4cb48202d9476f99e0c6, 4affffa1f0414a6186d1732c9249d955; no voters:
I20260923 19:46:25.589290 31754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4901dfa5be741be8e4736bab3a91b46" candidate_uuid: "4affffa1f0414a6186d1732c9249d955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" is_pre_election: true
I20260923 19:46:25.589550 31824 raft_consensus.cc:2781] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:46:25.589699 31824 raft_consensus.cc:482] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:46:25.589821 31824 raft_consensus.cc:3037] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:25.589859 31754 raft_consensus.cc:2454] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4affffa1f0414a6186d1732c9249d955 in term 0.
I20260923 19:46:25.592356 31824 raft_consensus.cc:504] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.592913 31824 leader_election.cc:288] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [CANDIDATE]: Term 1 election: Requested vote from peers 7e6be6ae3fc8449d9b78fb07221b5f1e (127.13.88.195:39093), 2891306ee01a4cb48202d9476f99e0c6 (127.13.88.194:45041)
I20260923 19:46:25.593394 31754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4901dfa5be741be8e4736bab3a91b46" candidate_uuid: "4affffa1f0414a6186d1732c9249d955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e"
I20260923 19:46:25.593444 31624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4901dfa5be741be8e4736bab3a91b46" candidate_uuid: "4affffa1f0414a6186d1732c9249d955" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2891306ee01a4cb48202d9476f99e0c6"
I20260923 19:46:25.593585 31754 raft_consensus.cc:3037] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:25.593606 31624 raft_consensus.cc:3037] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:46:25.596637 31539 tablet.cc:2369] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:46:25.596787 31754 raft_consensus.cc:2454] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4affffa1f0414a6186d1732c9249d955 in term 1.
I20260923 19:46:25.596801 31624 raft_consensus.cc:2454] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4affffa1f0414a6186d1732c9249d955 in term 1.
I20260923 19:46:25.597146 31428 leader_election.cc:302] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4affffa1f0414a6186d1732c9249d955, 7e6be6ae3fc8449d9b78fb07221b5f1e; no voters:
I20260923 19:46:25.597414 31824 raft_consensus.cc:2781] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:25.597864 31824 raft_consensus.cc:686] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 1 LEADER]: Becoming Leader. State: Replica: 4affffa1f0414a6186d1732c9249d955, State: Running, Role: LEADER
I20260923 19:46:25.598328 31824 consensus_queue.cc:237] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } }
I20260923 19:46:25.602605 31351 catalog_manager.cc:5495] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4affffa1f0414a6186d1732c9249d955 (127.13.88.193). New cstate: current_term: 1 leader_uuid: "4affffa1f0414a6186d1732c9249d955" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4affffa1f0414a6186d1732c9249d955" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 44527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 } health_report { overall_health: UNKNOWN } } }
I20260923 19:46:25.618152 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.613172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36764 (local address 127.13.88.193:44527)
0923 19:46:25.613348 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.613353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.613458 (+ 105us) server_negotiation.cc:407] Connection header received
0923 19:46:25.613622 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.613625 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.613702 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.613858 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:46:25.614143 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.614823 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.616227 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.616611 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.616701 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.617193 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:46:25.617657 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:46:25.617766 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.617889 (+ 123us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.617961 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:46:25.626117 31754 raft_consensus.cc:1261] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 1 FOLLOWER]: Refusing update from remote peer 4affffa1f0414a6186d1732c9249d955: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:25.626129 31624 raft_consensus.cc:1261] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 1 FOLLOWER]: Refusing update from remote peer 4affffa1f0414a6186d1732c9249d955: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:25.627027 31824 consensus_queue.cc:1035] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2891306ee01a4cb48202d9476f99e0c6" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 45041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:25.627398 31828 consensus_queue.cc:1035] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e6be6ae3fc8449d9b78fb07221b5f1e" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 39093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:25.639657 31833 mvcc.cc:205] Tried to move back new op lower bound from 7332629649915060224 to 7332629649814843392. Current Snapshot: MvccSnapshot[applied={T|T < 7332629649915060224}]
I20260923 19:46:25.640391 31832 mvcc.cc:205] Tried to move back new op lower bound from 7332629649915060224 to 7332629649814843392. Current Snapshot: MvccSnapshot[applied={T|T < 7332629649915060224}]
I20260923 19:46:25.653928 31352 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:25.654206 31352 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:25.657596 31352 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b57d2dd025704e618ec79d70b73797a8: Sending DeleteTablet for 3 replicas of tablet c4901dfa5be741be8e4736bab3a91b46
I20260923 19:46:25.658663 31473 tablet_service.cc:1514] Processing DeleteTablet for tablet c4901dfa5be741be8e4736bab3a91b46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:25 UTC) from {username='slave'} at 127.0.0.1:36748
I20260923 19:46:25.658764 31734 tablet_service.cc:1514] Processing DeleteTablet for tablet c4901dfa5be741be8e4736bab3a91b46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:25 UTC) from {username='slave'} at 127.0.0.1:45558
I20260923 19:46:25.659021 31604 tablet_service.cc:1514] Processing DeleteTablet for tablet c4901dfa5be741be8e4736bab3a91b46 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:25 UTC) from {username='slave'} at 127.0.0.1:33092
I20260923 19:46:25.659821 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31411
I20260923 19:46:25.671432 31844 tablet_replica.cc:330] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: stopping tablet replica
I20260923 19:46:25.672128 31844 raft_consensus.cc:2229] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:25.672879 31844 raft_consensus.cc:2258] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:25.675602 31844 ts_tablet_manager.cc:1905] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:25.677306 31843 tablet_replica.cc:330] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: stopping tablet replica
I20260923 19:46:25.679869 31842 tablet_replica.cc:330] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: stopping tablet replica
I20260923 19:46:25.680423 31842 raft_consensus.cc:2229] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:46:25.681227 31842 raft_consensus.cc:2258] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:25.683051 31844 ts_tablet_manager.cc:1918] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:25.683259 31844 log.cc:1196] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/c4901dfa5be741be8e4736bab3a91b46
I20260923 19:46:25.683573 31842 ts_tablet_manager.cc:1905] T c4901dfa5be741be8e4736bab3a91b46 P 4affffa1f0414a6186d1732c9249d955: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:25.683892 31844 ts_tablet_manager.cc:1939] T c4901dfa5be741be8e4736bab3a91b46 P 2891306ee01a4cb48202d9476f99e0c6: Deleting consensus metadata
I20260923 19:46:25.683950 31843 raft_consensus.cc:2229] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:25.684504 31843 raft_consensus.cc:2258] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:25.685810 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.661308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36772 (local address 127.13.88.193:44527)
0923 19:46:25.661530 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.661540 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.676777 (+ 15237us) server_negotiation.cc:407] Connection header received
0923 19:46:25.677297 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.677306 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.677435 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.677543 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:25.678420 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.679891 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.681894 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.682533 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.682629 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.684103 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:25.684113 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:25.684127 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:25.684905 (+ 778us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:25.684964 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:25.684986 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:25.685059 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.685315 (+ 256us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.685437 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:46:25.685797 31338 catalog_manager.cc:4841] TS 2891306ee01a4cb48202d9476f99e0c6 (127.13.88.194:45041): tablet c4901dfa5be741be8e4736bab3a91b46 (table test-table [id=b2d4086fbe9a4bffbdb0b4759acae188]) successfully deleted
I20260923 19:46:25.686616 31843 ts_tablet_manager.cc:1905] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:25.687153 31533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:25.693622 31843 ts_tablet_manager.cc:1918] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:25.693740 31843 log.cc:1196] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/c4901dfa5be741be8e4736bab3a91b46
I20260923 19:46:25.694199 31843 ts_tablet_manager.cc:1939] T c4901dfa5be741be8e4736bab3a91b46 P 7e6be6ae3fc8449d9b78fb07221b5f1e: Deleting consensus metadata
I20260923 19:46:25.695734 31338 catalog_manager.cc:4841] TS 7e6be6ae3fc8449d9b78fb07221b5f1e (127.13.88.195:39093): tablet c4901dfa5be741be8e4736bab3a91b46 (table test-table [id=b2d4086fbe9a4bffbdb0b4759acae188]) successfully deleted
I20260923 19:46:25.781414 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31411
W20260923 19:46:25.798971 31336 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.88.193:44527 (error 108)
I20260923 19:46:25.799665 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31542
I20260923 19:46:25.801016 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.800436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36786)
0923 19:46:25.800666 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.800839 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260923 19:46:25.801270 31336 catalog_manager.cc:4584] TS 4affffa1f0414a6186d1732c9249d955 (127.13.88.193:44527): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4901dfa5be741be8e4736bab3a91b46: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
I20260923 19:46:25.806589 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.800474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33100 (local address 127.13.88.194:45041)
0923 19:46:25.800701 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.800707 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.800729 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:46:25.800876 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.800882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.801010 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.801131 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:25.801576 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.802253 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.803702 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.804081 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.804168 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.805185 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:25.805193 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:25.805207 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:25.805860 (+ 653us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:25.805908 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:25.805928 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:25.806018 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.806156 (+ 138us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.806286 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260923 19:46:25.807348 31664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:25.855070 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.854521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36794)
0923 19:46:25.854792 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.854902 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260923 19:46:25.856235 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.855863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36798)
0923 19:46:25.856042 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.856118 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 19:46:25.896499 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31542
I20260923 19:46:25.914388 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31672
I20260923 19:46:25.916495 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.916063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36804)
0923 19:46:25.916235 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.916310 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260923 19:46:25.917481 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.917155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36818)
0923 19:46:25.917299 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.917367 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260923 19:46:25.921129 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.915263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45562 (local address 127.13.88.195:39093)
0923 19:46:25.915425 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:25.915429 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:25.915449 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:46:25.915506 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:25.915509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:25.915588 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:25.915704 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:25.916083 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.916940 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.918373 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:25.918759 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:25.918851 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:25.919787 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:25.919795 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:25.919810 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:25.920470 (+ 660us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:25.920516 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:25.920534 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:25.920617 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:25.920706 (+ 89us) server_negotiation.cc:299] Negotiation successful
0923 19:46:25.920792 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 19:46:25.921818 31794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:25.998113 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.997656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36826)
0923 19:46:25.997862 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.997953 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 19:46:25.999213 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:25.998759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:44527 (local address 127.0.0.1:36832)
0923 19:46:25.998944 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:25.999038 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:44527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260923 19:46:26.011600 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31672
I20260923 19:46:26.028394 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31321
I20260923 19:46:26.029435 31382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:26.135566 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31321
2026-09-23T19:46:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2563 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:26 dist-test-slave-xg7f krb5kdc[31853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:26 dist-test-slave-xg7f krb5kdc[31853](info): set up 2 sockets
Sep 23 19:46:26 dist-test-slave-xg7f krb5kdc[31853](info): commencing operation
krb5kdc: starting...
W20260923 19:46:27.231041 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.003s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:27 dist-test-slave-xg7f krb5kdc[31853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:46:27.458035 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:34755
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:34755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:27.784466 31866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:27.784739 31866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:27.784837 31866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:27.792001 31866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:27.792106 31866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:27.792151 31866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:27.792209 31866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:27.792253 31866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:27.801930 31866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:34755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:34755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:27.803201 31866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:27.804416 31866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:27.816102 31872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:27.816130 31871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:27.816123 31874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:27.817024 31866 server_base.cc:1034] running on GCE node
I20260923 19:46:27.817795 31866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:27.819237 31866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:27.820478 31866 hybrid_clock.cc:648] HybridClock initialized: now 1790192787820414 us; error 67 us; skew 500 ppm
I20260923 19:46:27.820839 31866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:27 dist-test-slave-xg7f krb5kdc[31853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192787, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:27.823848 31866 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:46:27.825266 31866 webserver.cc:460] Webserver started at http://127.13.88.254:42985/ using document root <none> and password file <none>
I20260923 19:46:27.825939 31866 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:27.826081 31866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:27.826386 31866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:27.829283 31866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "aab71b3c574f41a090cd8434e8aee01e"
format_stamp: "Formatted at 2026-09-23 19:46:27 on dist-test-slave-xg7f"
server_key: "ec56c91cbcfa7962039aef41bb75bbe5"
server_key_iv: "2ae4856f20efd8802c6d240a8011829d"
server_key_version: "encryptionkey@0"
I20260923 19:46:27.830061 31866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "aab71b3c574f41a090cd8434e8aee01e"
format_stamp: "Formatted at 2026-09-23 19:46:27 on dist-test-slave-xg7f"
server_key: "ec56c91cbcfa7962039aef41bb75bbe5"
server_key_iv: "2ae4856f20efd8802c6d240a8011829d"
server_key_version: "encryptionkey@0"
I20260923 19:46:27.835076 31866 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:46:27.838323 31881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:27.839579 31866 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:27.839757 31866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "aab71b3c574f41a090cd8434e8aee01e"
format_stamp: "Formatted at 2026-09-23 19:46:27 on dist-test-slave-xg7f"
server_key: "ec56c91cbcfa7962039aef41bb75bbe5"
server_key_iv: "2ae4856f20efd8802c6d240a8011829d"
server_key_version: "encryptionkey@0"
I20260923 19:46:27.839972 31866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:27.859902 31866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:27.863869 31866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:27.864137 31866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:27.882296 31866 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:34755
I20260923 19:46:27.882334 31932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:34755 every 8 connection(s)
I20260923 19:46:27.883739 31866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:27.887337 31933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:27.890950 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31866
I20260923 19:46:27.891144 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:27.891692 13667 external_mini_cluster.cc:1428] Setting key c67ce33696d0534829b0c56b915f91cf
I20260923 19:46:27.899981 31933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e: Bootstrap starting.
I20260923 19:46:27.903718 31933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:27.905026 31933 log.cc:824] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:46:27 dist-test-slave-xg7f krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:27.907966 31933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e: No bootstrap required, opened a new log
I20260923 19:46:27.915952 31936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:27.893495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.13.88.254:34755)
0923 19:46:27.894213 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:27.894223 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:27.894262 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:46:27.895950 (+ 1688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:27.895973 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:27.896367 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:27.896680 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:27.898431 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:27.899799 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:27.901650 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:27.902329 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:27.902453 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:27.907284 (+ 4831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:27.907294 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:27.907311 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:27.907363 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:27.911374 (+ 4011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:27.912084 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:27.912097 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:27.912111 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:27.912332 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:27.912684 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:27.912690 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:27.912694 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:27.913383 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:27.913679 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:27.914022 (+ 343us) server_negotiation.cc:299] Negotiation successful
0923 19:46:27.914486 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":344,"threads_started":1}
I20260923 19:46:27.918752 31933 raft_consensus.cc:348] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab71b3c574f41a090cd8434e8aee01e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34755 } }
I20260923 19:46:27.919257 31933 raft_consensus.cc:374] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:27.919345 31933 raft_consensus.cc:729] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab71b3c574f41a090cd8434e8aee01e, State: Initialized, Role: FOLLOWER
I20260923 19:46:27.919912 31933 consensus_queue.cc:260] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab71b3c574f41a090cd8434e8aee01e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34755 } }
I20260923 19:46:27.920125 31933 raft_consensus.cc:388] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:27.920226 31933 raft_consensus.cc:482] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:27.920360 31933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:27.922492 31933 raft_consensus.cc:504] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab71b3c574f41a090cd8434e8aee01e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34755 } }
I20260923 19:46:27.923118 31933 leader_election.cc:302] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aab71b3c574f41a090cd8434e8aee01e; no voters:
I20260923 19:46:27.923720 31933 leader_election.cc:288] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:27.923874 31938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:27.924571 31938 raft_consensus.cc:686] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [term 1 LEADER]: Becoming Leader. State: Replica: aab71b3c574f41a090cd8434e8aee01e, State: Running, Role: LEADER
I20260923 19:46:27.925105 31938 consensus_queue.cc:237] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab71b3c574f41a090cd8434e8aee01e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34755 } }
I20260923 19:46:27.925755 31933 sys_catalog.cc:564] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:27.928874 31939 sys_catalog.cc:455] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aab71b3c574f41a090cd8434e8aee01e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab71b3c574f41a090cd8434e8aee01e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34755 } } }
I20260923 19:46:27.928943 31940 sys_catalog.cc:455] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [sys.catalog]: SysCatalogTable state changed. Reason: New leader aab71b3c574f41a090cd8434e8aee01e. Latest consensus state: current_term: 1 leader_uuid: "aab71b3c574f41a090cd8434e8aee01e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aab71b3c574f41a090cd8434e8aee01e" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 34755 } } }
I20260923 19:46:27.929293 31939 sys_catalog.cc:458] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:27.929315 31940 sys_catalog.cc:458] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:27.932474 31945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:27.938422 31945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:27.947273 31945 catalog_manager.cc:1347] Generated new cluster ID: 2ddc4f5663554c26b124641bfc48caa9
I20260923 19:46:27.947396 31945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:27.957222 31945 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:27.958488 31945 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:27.980957 31945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e: Generated new TSK 0
I20260923 19:46:27.981833 31945 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:46:28.050135 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:34755
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:28.371695 31959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:28.371965 31959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:28.372141 31959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:28.379654 31959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:28.379777 31959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:28.379958 31959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:46:28.389526 31959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:34755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:28.390818 31959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:28.392107 31959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:28.404909 31964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:28.404960 31967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:28.404989 31965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:28.405711 31959 server_base.cc:1034] running on GCE node
I20260923 19:46:28.406334 31959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:28.407264 31959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:28.408480 31959 hybrid_clock.cc:648] HybridClock initialized: now 1790192788408445 us; error 54 us; skew 500 ppm
I20260923 19:46:28.408780 31959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:28 dist-test-slave-xg7f krb5kdc[31853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192788, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:28.411859 31959 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:46:28.413271 31959 webserver.cc:460] Webserver started at http://127.13.88.193:34623/ using document root <none> and password file <none>
I20260923 19:46:28.413944 31959 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:28.414085 31959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:28.414418 31959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:28.417330 31959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "cd05e97566e94a6c9cc0f80f6c36de9e"
format_stamp: "Formatted at 2026-09-23 19:46:28 on dist-test-slave-xg7f"
server_key: "d2f8d308ffbf30655aaeb8c32cccdc63"
server_key_iv: "a1d06f776a9eef5e263a1951c67a0818"
server_key_version: "encryptionkey@0"
I20260923 19:46:28.418077 31959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "cd05e97566e94a6c9cc0f80f6c36de9e"
format_stamp: "Formatted at 2026-09-23 19:46:28 on dist-test-slave-xg7f"
server_key: "d2f8d308ffbf30655aaeb8c32cccdc63"
server_key_iv: "a1d06f776a9eef5e263a1951c67a0818"
server_key_version: "encryptionkey@0"
I20260923 19:46:28.423059 31959 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260923 19:46:28.426373 31974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:28.427747 31959 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:28.427912 31959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "cd05e97566e94a6c9cc0f80f6c36de9e"
format_stamp: "Formatted at 2026-09-23 19:46:28 on dist-test-slave-xg7f"
server_key: "d2f8d308ffbf30655aaeb8c32cccdc63"
server_key_iv: "a1d06f776a9eef5e263a1951c67a0818"
server_key_version: "encryptionkey@0"
I20260923 19:46:28.428114 31959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:28.442143 31959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:28.446038 31959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:28.446316 31959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:28.447269 31959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:28.448524 31959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:28.448621 31959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:28.448756 31959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:28.448828 31959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:28.481113 31959 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:35403
I20260923 19:46:28.481133 32086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:35403 every 8 connection(s)
I20260923 19:46:28.482497 31959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:46:28.485610 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 31959
I20260923 19:46:28.485790 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:46:28.486438 13667 external_mini_cluster.cc:1428] Setting key f8d2f922d5951a4f708492e906e6f649
Sep 23 19:46:28 dist-test-slave-xg7f krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192788, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:28.503594 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:28.485030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:54407 (local address 127.13.88.254:34755)
0923 19:46:28.485494 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:28.485498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:28.487027 (+ 1529us) server_negotiation.cc:407] Connection header received
0923 19:46:28.488653 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:28.488658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:28.488764 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:28.488902 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:28.490346 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.491095 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.492635 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.493040 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.493173 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:28.496926 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:28.496935 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:28.496943 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:28.496987 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:28.500530 (+ 3543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:28.501189 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:28.501196 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:28.501202 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:28.501352 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:28.501720 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:28.501728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:28.501734 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:28.502093 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:28.502235 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:28.502841 (+ 606us) server_negotiation.cc:299] Negotiation successful
0923 19:46:28.503085 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":230,"threads_started":1}
I20260923 19:46:28.504161 32090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:28.485640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:34755 (local address 127.13.88.193:54407)
0923 19:46:28.486436 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:28.486475 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:28.488406 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:28.489141 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:28.489148 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:28.489636 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:28.490177 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:28.490193 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.491291 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.491295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:28.492479 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:28.492490 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.493254 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.493263 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:28.493529 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:28.494189 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:28.494210 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:28.496707 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:28.500666 (+ 3959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:28.500672 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:28.500684 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:28.501074 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:28.501452 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:28.501455 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:28.501457 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:28.501620 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:28.502203 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:28.502208 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:28.502489 (+ 281us) client_negotiation.cc:769] Sending connection context
0923 19:46:28.502704 (+ 215us) client_negotiation.cc:240] Negotiation successful
0923 19:46:28.503063 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":312,"threads_started":1}
I20260923 19:46:28.505702 32087 heartbeater.cc:347] Connected to a master server at 127.13.88.254:34755
I20260923 19:46:28.505999 32087 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:28.506691 32087 heartbeater.cc:511] Master 127.13.88.254:34755 requested a full tablet report, sending...
I20260923 19:46:28.508756 31898 ts_manager.cc:194] Registered new tserver with Master: cd05e97566e94a6c9cc0f80f6c36de9e (127.13.88.193:35403)
I20260923 19:46:28.510102 31898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:54407
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:46:28.538228 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:34755
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:28.857352 32093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:28.857625 32093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:28.857717 32093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:28.864828 32093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:28.864946 32093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:28.865054 32093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:46:28.874601 32093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:34755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:28.875909 32093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:28.877225 32093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:28.892118 32098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:28.892153 32099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:28.892830 32101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:28.899168 32093 server_base.cc:1034] running on GCE node
I20260923 19:46:28.899741 32093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:28.900658 32093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:28.901890 32093 hybrid_clock.cc:648] HybridClock initialized: now 1790192788901828 us; error 58 us; skew 500 ppm
I20260923 19:46:28.902190 32093 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:28 dist-test-slave-xg7f krb5kdc[31853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192788, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:28.905263 32093 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:46:28.906818 32093 webserver.cc:460] Webserver started at http://127.13.88.194:45683/ using document root <none> and password file <none>
I20260923 19:46:28.907600 32093 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:28.907753 32093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:28.908082 32093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:28.910933 32093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "300b3763e5764727a944538afb90ede4"
format_stamp: "Formatted at 2026-09-23 19:46:28 on dist-test-slave-xg7f"
server_key: "9b71e7d5a7e5e9ba7efdbfd09682d1e5"
server_key_iv: "2e9e6e19f7976c0b75b01682cfea4703"
server_key_version: "encryptionkey@0"
I20260923 19:46:28.911743 32093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "300b3763e5764727a944538afb90ede4"
format_stamp: "Formatted at 2026-09-23 19:46:28 on dist-test-slave-xg7f"
server_key: "9b71e7d5a7e5e9ba7efdbfd09682d1e5"
server_key_iv: "2e9e6e19f7976c0b75b01682cfea4703"
server_key_version: "encryptionkey@0"
I20260923 19:46:28.916826 32093 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:46:28.920418 32108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:28.921726 32093 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:46:28.921905 32093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "300b3763e5764727a944538afb90ede4"
format_stamp: "Formatted at 2026-09-23 19:46:28 on dist-test-slave-xg7f"
server_key: "9b71e7d5a7e5e9ba7efdbfd09682d1e5"
server_key_iv: "2e9e6e19f7976c0b75b01682cfea4703"
server_key_version: "encryptionkey@0"
I20260923 19:46:28.922106 32093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:28.947284 32093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:28.951246 32093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:28.951540 32093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:28.952491 32093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:28.953785 32093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:28.953895 32093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:28.954037 32093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:28.954109 32093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:28.986478 32093 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:36707
I20260923 19:46:28.986521 32220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:36707 every 8 connection(s)
I20260923 19:46:28.987775 32093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:46:28.989270 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 32093
I20260923 19:46:28.989419 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:46:28.989807 13667 external_mini_cluster.cc:1428] Setting key b15bcdff8dcfc39054d795fabca8fbcf
Sep 23 19:46:28 dist-test-slave-xg7f krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192788, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:29.009574 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:28.991674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:53653 (local address 127.13.88.254:34755)
0923 19:46:28.991888 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:28.991895 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:28.993013 (+ 1118us) server_negotiation.cc:407] Connection header received
0923 19:46:28.994826 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:28.994832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:28.994926 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:28.995031 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:28.996481 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.997175 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.998698 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.999195 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.999322 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.002597 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:29.002605 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:29.002613 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:29.002655 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:29.006309 (+ 3654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.007022 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.007031 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.007038 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.007224 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.007623 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.007631 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.007637 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.008048 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:29.008200 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.008866 (+ 666us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.009130 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:46:29.010236 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:28.992126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:34755 (local address 127.13.88.194:53653)
0923 19:46:28.992861 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:28.992900 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:28.994556 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:28.995286 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:28.995294 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:28.995774 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:28.996307 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:28.996324 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.997332 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.997335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:28.998548 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:28.998559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:28.999416 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:28.999423 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:28.999645 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.000303 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:29.000323 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:29.002375 (+ 2052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:29.006455 (+ 4080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:29.006462 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:29.006474 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:29.006892 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:29.007331 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:29.007334 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:29.007337 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:29.007514 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:29.008179 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:29.008185 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:29.008491 (+ 306us) client_negotiation.cc:769] Sending connection context
0923 19:46:29.008715 (+ 224us) client_negotiation.cc:240] Negotiation successful
0923 19:46:29.009113 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":301,"threads_started":1}
I20260923 19:46:29.012246 32221 heartbeater.cc:347] Connected to a master server at 127.13.88.254:34755
I20260923 19:46:29.012809 32221 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:29.013872 32221 heartbeater.cc:511] Master 127.13.88.254:34755 requested a full tablet report, sending...
I20260923 19:46:29.015600 31898 ts_manager.cc:194] Registered new tserver with Master: 300b3763e5764727a944538afb90ede4 (127.13.88.194:36707)
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
I20260923 19:46:29.016479 31898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:53653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:46:29.045382 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:34755
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:29.359833 32226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:29.360131 32226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:29.360321 32226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:29.367556 32226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:29.367693 32226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:29.367893 32226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:46:29.377532 32226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:34755
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:29.378846 32226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:29.380452 32226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:29.393324 32232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:29.393404 32231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:29.393400 32234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:29.394232 32226 server_base.cc:1034] running on GCE node
I20260923 19:46:29.394801 32226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:29.395714 32226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:29.396903 32226 hybrid_clock.cc:648] HybridClock initialized: now 1790192789396867 us; error 32 us; skew 500 ppm
I20260923 19:46:29.397231 32226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:29 dist-test-slave-xg7f krb5kdc[31853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192789, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:29.404981 32226 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:46:29.406385 32226 webserver.cc:460] Webserver started at http://127.13.88.195:42705/ using document root <none> and password file <none>
I20260923 19:46:29.407034 32226 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:29.407207 32226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:29.407480 32226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:29.410172 32226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "7b2592f0c1574683851129e927bde1d4"
format_stamp: "Formatted at 2026-09-23 19:46:29 on dist-test-slave-xg7f"
server_key: "77db23cd5627cc32829d1a78d6e3a619"
server_key_iv: "74119f1d7a15aa00c1bc40d448cd1405"
server_key_version: "encryptionkey@0"
I20260923 19:46:29.410874 32226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "7b2592f0c1574683851129e927bde1d4"
format_stamp: "Formatted at 2026-09-23 19:46:29 on dist-test-slave-xg7f"
server_key: "77db23cd5627cc32829d1a78d6e3a619"
server_key_iv: "74119f1d7a15aa00c1bc40d448cd1405"
server_key_version: "encryptionkey@0"
I20260923 19:46:29.415930 32226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:46:29.419234 32241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:29.420575 32226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:46:29.420730 32226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "7b2592f0c1574683851129e927bde1d4"
format_stamp: "Formatted at 2026-09-23 19:46:29 on dist-test-slave-xg7f"
server_key: "77db23cd5627cc32829d1a78d6e3a619"
server_key_iv: "74119f1d7a15aa00c1bc40d448cd1405"
server_key_version: "encryptionkey@0"
I20260923 19:46:29.420922 32226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:29.438805 32226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:29.442543 32226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:29.442822 32226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:29.443854 32226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:29.445109 32226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:29.445207 32226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:29.445372 32226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:29.445441 32226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:29.477542 32226 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:40771
I20260923 19:46:29.477589 32353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:40771 every 8 connection(s)
I20260923 19:46:29.478849 32226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:46:29.488031 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 32226
I20260923 19:46:29.488212 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:46:29.488638 13667 external_mini_cluster.cc:1428] Setting key 5df109e77c0de618a8b73052fcc98c33
Sep 23 19:46:29 dist-test-slave-xg7f krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192789, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:29.497856 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.481414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:51935 (local address 127.13.88.254:34755)
0923 19:46:29.481588 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.481593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.482851 (+ 1258us) server_negotiation.cc:407] Connection header received
0923 19:46:29.484668 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.484674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.484757 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.484884 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:29.486285 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.487046 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.488666 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.489186 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.489327 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.493048 (+ 3721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:29.493054 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:29.493057 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:29.493087 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:29.495443 (+ 2356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.496055 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.496059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.496061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.496180 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.496526 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.496529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.496531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.496782 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:29.496888 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.497472 (+ 584us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.497626 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:46:29.498777 32356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.482001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:34755 (local address 127.13.88.195:51935)
0923 19:46:29.482688 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:29.482728 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:29.484358 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:29.485120 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:29.485127 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:29.485580 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:29.486089 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.486103 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.487214 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.487224 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.488529 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.488541 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.489426 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.489435 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.489709 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.490556 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:29.490601 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:29.492870 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:29.495563 (+ 2693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:29.495569 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:29.495580 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:29.495961 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:29.496274 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:29.496277 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:29.496279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:29.496438 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:29.496883 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:29.496888 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:29.497165 (+ 277us) client_negotiation.cc:769] Sending connection context
0923 19:46:29.497390 (+ 225us) client_negotiation.cc:240] Negotiation successful
0923 19:46:29.497733 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":282,"threads_started":1}
I20260923 19:46:29.500136 32354 heartbeater.cc:347] Connected to a master server at 127.13.88.254:34755
I20260923 19:46:29.500398 32354 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:29.501055 32354 heartbeater.cc:511] Master 127.13.88.254:34755 requested a full tablet report, sending...
I20260923 19:46:29.502566 31898 ts_manager.cc:194] Registered new tserver with Master: 7b2592f0c1574683851129e927bde1d4 (127.13.88.195:40771)
I20260923 19:46:29.503754 31898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:51935
I20260923 19:46:29.503791 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:46:29.512954 32087 heartbeater.cc:503] Master 127.13.88.254:34755 was elected leader, sending a full tablet report...
I20260923 19:46:29.520288 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.507935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50580 (local address 127.13.88.254:34755)
0923 19:46:29.508079 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.508083 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.508513 (+ 430us) server_negotiation.cc:407] Connection header received
0923 19:46:29.508636 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.508640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.508692 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.508768 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:29.510133 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.510992 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.512337 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.512766 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.512855 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.515754 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:29.515758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:29.515761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:29.515788 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:29.518038 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.518658 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.518661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.518663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.518771 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.519167 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.519170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.519172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.519455 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:29.519643 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.519963 (+ 320us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.520083 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 19:46:29.523957 31898 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:46:29.530755 31898 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:46:29.552677 32368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.542650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:35403 (local address 127.0.0.1:49062)
0923 19:46:29.543877 (+ 1227us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:29.543893 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:29.544011 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:29.546194 (+ 2183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:29.546198 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:29.546223 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:29.546623 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.546637 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.548485 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.548490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.550165 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.550175 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.551685 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.551691 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.551869 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.551921 (+ 52us) client_negotiation.cc:769] Sending connection context
0923 19:46:29.552034 (+ 113us) client_negotiation.cc:240] Negotiation successful
0923 19:46:29.552204 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"mutex_wait_us":116,"thread_start_us":1506,"threads_started":1}
I20260923 19:46:29.553407 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.542266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:40771 (local address 127.0.0.1:49806)
0923 19:46:29.543172 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:29.543212 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:29.543353 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:29.546687 (+ 3334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:29.546691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:29.546714 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:29.547046 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.547059 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.548863 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.548869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.550909 (+ 2040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.550924 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.552657 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.552666 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.552828 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.552858 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 19:46:29.552958 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 19:46:29.553086 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":550,"threads_started":1}
I20260923 19:46:29.553483 32367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.542523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.13.88.195:40771)
0923 19:46:29.546136 (+ 3613us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.546145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.546172 (+ 27us) server_negotiation.cc:407] Connection header received
0923 19:46:29.546256 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.546265 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.546488 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.546677 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:29.547291 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.548721 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.551067 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.552432 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.552556 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.552798 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.552998 (+ 200us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.553148 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3452,"thread_start_us":3312,"threads_started":1}
I20260923 19:46:29.553789 32370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.543577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:36707 (local address 127.0.0.1:39274)
0923 19:46:29.544476 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:29.544490 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:29.544579 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:29.545727 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:29.545734 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:29.545762 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:29.546123 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.546138 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.548234 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.548239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.551409 (+ 3170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.551424 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.552991 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.552996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.553159 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.553204 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 19:46:29.553291 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 19:46:29.553407 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"mutex_wait_us":123,"thread_start_us":676,"threads_started":1}
I20260923 19:46:29.554394 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.543250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.13.88.193:35403)
0923 19:46:29.545659 (+ 2409us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.545670 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.545695 (+ 25us) server_negotiation.cc:407] Connection header received
0923 19:46:29.545775 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.545784 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.545987 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.546183 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:29.546814 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.548349 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.550309 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.551474 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.553393 (+ 1919us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.553871 (+ 478us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.553942 (+ 71us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.554087 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2235,"thread_start_us":2080,"threads_started":1}
I20260923 19:46:29.554436 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.543854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39274 (local address 127.13.88.194:36707)
0923 19:46:29.545092 (+ 1238us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.545101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.545127 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:46:29.545221 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.545231 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.545501 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.546306 (+ 805us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:29.546506 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.548094 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.551575 (+ 3481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.552546 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.552686 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.552861 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.554069 (+ 1208us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.554188 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1038,"thread_start_us":899,"threads_started":1}
I20260923 19:46:29.557514 32156 tablet_service.cc:1467] Processing CreateTablet for tablet 243b7913cbf24b16a41a24408b358079 (DEFAULT_TABLE table=test-table [id=c0f5d129253c4ed18bd34133fa82379e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:29.557548 32289 tablet_service.cc:1467] Processing CreateTablet for tablet 243b7913cbf24b16a41a24408b358079 (DEFAULT_TABLE table=test-table [id=c0f5d129253c4ed18bd34133fa82379e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:29.557708 32022 tablet_service.cc:1467] Processing CreateTablet for tablet 243b7913cbf24b16a41a24408b358079 (DEFAULT_TABLE table=test-table [id=c0f5d129253c4ed18bd34133fa82379e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:29.558678 32156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243b7913cbf24b16a41a24408b358079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:29.558931 32022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243b7913cbf24b16a41a24408b358079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:29.558954 32289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243b7913cbf24b16a41a24408b358079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:29.569439 32372 tablet_bootstrap.cc:492] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Bootstrap starting.
I20260923 19:46:29.572824 32373 tablet_bootstrap.cc:492] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Bootstrap starting.
I20260923 19:46:29.573578 32374 tablet_bootstrap.cc:492] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Bootstrap starting.
I20260923 19:46:29.574512 32372 tablet_bootstrap.cc:654] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:29.575861 32372 log.cc:824] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:29.576740 32373 tablet_bootstrap.cc:654] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:29.577064 32374 tablet_bootstrap.cc:654] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:29.577780 32373 log.cc:824] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:29.578236 32374 log.cc:824] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:29.579100 32372 tablet_bootstrap.cc:492] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: No bootstrap required, opened a new log
I20260923 19:46:29.579370 32372 ts_tablet_manager.cc:1397] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260923 19:46:29.580420 32373 tablet_bootstrap.cc:492] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: No bootstrap required, opened a new log
I20260923 19:46:29.580658 32373 ts_tablet_manager.cc:1397] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260923 19:46:29.581071 32374 tablet_bootstrap.cc:492] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: No bootstrap required, opened a new log
I20260923 19:46:29.581295 32374 ts_tablet_manager.cc:1397] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260923 19:46:29.586818 32372 raft_consensus.cc:348] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.587224 32372 raft_consensus.cc:374] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:29.587352 32372 raft_consensus.cc:729] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 300b3763e5764727a944538afb90ede4, State: Initialized, Role: FOLLOWER
I20260923 19:46:29.588001 32372 consensus_queue.cc:260] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.589087 32221 heartbeater.cc:503] Master 127.13.88.254:34755 was elected leader, sending a full tablet report...
I20260923 19:46:29.589781 32372 ts_tablet_manager.cc:1428] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Time spent starting tablet: real 0.010s user 0.008s sys 0.001s
I20260923 19:46:29.590922 32373 raft_consensus.cc:348] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.591362 32373 raft_consensus.cc:374] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:29.591482 32373 raft_consensus.cc:729] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2592f0c1574683851129e927bde1d4, State: Initialized, Role: FOLLOWER
I20260923 19:46:29.591446 32374 raft_consensus.cc:348] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.591863 32374 raft_consensus.cc:374] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:29.591974 32374 raft_consensus.cc:729] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd05e97566e94a6c9cc0f80f6c36de9e, State: Initialized, Role: FOLLOWER
I20260923 19:46:29.592057 32373 consensus_queue.cc:260] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.592553 32374 consensus_queue.cc:260] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.593458 32354 heartbeater.cc:503] Master 127.13.88.254:34755 was elected leader, sending a full tablet report...
I20260923 19:46:29.594255 32373 ts_tablet_manager.cc:1428] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260923 19:46:29.595788 32374 ts_tablet_manager.cc:1428] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260923 19:46:29.622470 32379 raft_consensus.cc:482] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:29.622761 32379 raft_consensus.cc:504] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.624500 32379 leader_election.cc:288] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 300b3763e5764727a944538afb90ede4 (127.13.88.194:36707), cd05e97566e94a6c9cc0f80f6c36de9e (127.13.88.193:35403)
I20260923 19:46:29.630939 32356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.624750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:36707 (local address 127.13.88.195:43993)
0923 19:46:29.624985 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:29.625006 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:29.625138 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:29.625719 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:29.625727 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:29.625758 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:29.626031 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.626044 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.627301 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.627305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.629161 (+ 1856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.629175 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.630415 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.630419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.630544 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.630566 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:46:29.630635 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 19:46:29.630734 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":3}
I20260923 19:46:29.631114 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.625195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:43993 (local address 127.13.88.194:36707)
0923 19:46:29.625454 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.625459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.625474 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:46:29.625529 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.625532 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.625584 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.625657 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:29.626161 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.627177 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.629317 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.630278 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.630417 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.630490 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.630688 (+ 198us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.630850 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260923 19:46:29.632026 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.624904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:59453 (local address 127.13.88.193:35403)
0923 19:46:29.625135 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.625144 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.625771 (+ 627us) server_negotiation.cc:407] Connection header received
0923 19:46:29.625927 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.625930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.626002 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.626107 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:29.626736 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.627687 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.629812 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.630993 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.631193 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.631286 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.631768 (+ 482us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.631862 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:46:29.632258 32381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.624858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:35403 (local address 127.13.88.195:59453)
0923 19:46:29.625655 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:29.625674 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:29.625777 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:29.626177 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:29.626185 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:29.626210 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:29.626555 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.626579 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.627833 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.627839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.629675 (+ 1836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:29.629685 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.631421 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.631426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:29.631536 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.631558 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 19:46:29.631733 (+ 175us) client_negotiation.cc:240] Negotiation successful
0923 19:46:29.631867 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":30,"thread_start_us":477,"threads_started":1}
I20260923 19:46:29.632174 32176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243b7913cbf24b16a41a24408b358079" candidate_uuid: "7b2592f0c1574683851129e927bde1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "300b3763e5764727a944538afb90ede4" is_pre_election: true
I20260923 19:46:29.632716 32176 raft_consensus.cc:2454] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b2592f0c1574683851129e927bde1d4 in term 0.
I20260923 19:46:29.633286 32042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243b7913cbf24b16a41a24408b358079" candidate_uuid: "7b2592f0c1574683851129e927bde1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" is_pre_election: true
I20260923 19:46:29.633488 32242 leader_election.cc:302] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 300b3763e5764727a944538afb90ede4, 7b2592f0c1574683851129e927bde1d4; no voters:
I20260923 19:46:29.633796 32042 raft_consensus.cc:2454] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b2592f0c1574683851129e927bde1d4 in term 0.
I20260923 19:46:29.633920 32379 raft_consensus.cc:2781] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:46:29.634053 32379 raft_consensus.cc:482] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:46:29.634150 32379 raft_consensus.cc:3037] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:29.636413 32379 raft_consensus.cc:504] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.637006 32379 leader_election.cc:288] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [CANDIDATE]: Term 1 election: Requested vote from peers 300b3763e5764727a944538afb90ede4 (127.13.88.194:36707), cd05e97566e94a6c9cc0f80f6c36de9e (127.13.88.193:35403)
I20260923 19:46:29.637315 32176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243b7913cbf24b16a41a24408b358079" candidate_uuid: "7b2592f0c1574683851129e927bde1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "300b3763e5764727a944538afb90ede4"
I20260923 19:46:29.637516 32176 raft_consensus.cc:3037] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:29.637598 32042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243b7913cbf24b16a41a24408b358079" candidate_uuid: "7b2592f0c1574683851129e927bde1d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e"
I20260923 19:46:29.637835 32042 raft_consensus.cc:3037] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:29.639863 32176 raft_consensus.cc:2454] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b2592f0c1574683851129e927bde1d4 in term 1.
I20260923 19:46:29.640091 32042 raft_consensus.cc:2454] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b2592f0c1574683851129e927bde1d4 in term 1.
I20260923 19:46:29.640259 32242 leader_election.cc:302] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 300b3763e5764727a944538afb90ede4, 7b2592f0c1574683851129e927bde1d4; no voters:
I20260923 19:46:29.640515 32379 raft_consensus.cc:2781] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:29.641019 32379 raft_consensus.cc:686] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 1 LEADER]: Becoming Leader. State: Replica: 7b2592f0c1574683851129e927bde1d4, State: Running, Role: LEADER
I20260923 19:46:29.641580 32379 consensus_queue.cc:237] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } }
I20260923 19:46:29.645864 31897 catalog_manager.cc:5495] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b2592f0c1574683851129e927bde1d4 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "7b2592f0c1574683851129e927bde1d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b2592f0c1574683851129e927bde1d4" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 40771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 } health_report { overall_health: UNKNOWN } } }
I20260923 19:46:29.679322 32367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.673941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49808 (local address 127.13.88.195:40771)
0923 19:46:29.674153 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.674162 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.674181 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:46:29.674277 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.674281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.674351 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.674506 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:46:29.674891 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.675662 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.677130 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.677515 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.677644 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.678258 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:46:29.678732 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:46:29.678912 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.679038 (+ 126us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.679084 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:46:29.687316 32042 raft_consensus.cc:1261] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 1 FOLLOWER]: Refusing update from remote peer 7b2592f0c1574683851129e927bde1d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:29.687317 32176 raft_consensus.cc:1261] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 1 FOLLOWER]: Refusing update from remote peer 7b2592f0c1574683851129e927bde1d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:29.688362 32382 consensus_queue.cc:1035] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "300b3763e5764727a944538afb90ede4" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:29.688726 32379 consensus_queue.cc:1035] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd05e97566e94a6c9cc0f80f6c36de9e" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:29.703029 32387 mvcc.cc:205] Tried to move back new op lower bound from 7332629666548580352 to 7332629666375815168. Current Snapshot: MvccSnapshot[applied={T|T < 7332629666548580352}]
I20260923 19:46:29.714092 31898 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:29.714365 31898 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:29.717774 31898 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aab71b3c574f41a090cd8434e8aee01e: Sending DeleteTablet for 3 replicas of tablet 243b7913cbf24b16a41a24408b358079
I20260923 19:46:29.718992 32022 tablet_service.cc:1514] Processing DeleteTablet for tablet 243b7913cbf24b16a41a24408b358079 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:29 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:49062
I20260923 19:46:29.718994 32156 tablet_service.cc:1514] Processing DeleteTablet for tablet 243b7913cbf24b16a41a24408b358079 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:29 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:39274
I20260923 19:46:29.719405 32289 tablet_service.cc:1514] Processing DeleteTablet for tablet 243b7913cbf24b16a41a24408b358079 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:29 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:49806
I20260923 19:46:29.720234 32395 tablet_replica.cc:330] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: stopping tablet replica
I20260923 19:46:29.720832 32394 tablet_replica.cc:330] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: stopping tablet replica
I20260923 19:46:29.721029 32396 tablet_replica.cc:330] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: stopping tablet replica
I20260923 19:46:29.721254 32394 raft_consensus.cc:2229] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:29.721530 32396 raft_consensus.cc:2229] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:46:29.721728 32394 raft_consensus.cc:2258] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:29.722294 32396 raft_consensus.cc:2258] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:29.722343 32395 raft_consensus.cc:2229] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:29.722819 32395 raft_consensus.cc:2258] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:29.722915 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31959
I20260923 19:46:29.724762 32396 ts_tablet_manager.cc:1905] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:29.725553 32395 ts_tablet_manager.cc:1905] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:29.727934 32394 ts_tablet_manager.cc:1905] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:29.732352 32396 ts_tablet_manager.cc:1918] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:29.732556 32396 log.cc:1196] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/243b7913cbf24b16a41a24408b358079
I20260923 19:46:29.733106 32396 ts_tablet_manager.cc:1939] T 243b7913cbf24b16a41a24408b358079 P 7b2592f0c1574683851129e927bde1d4: Deleting consensus metadata
I20260923 19:46:29.734779 31882 catalog_manager.cc:4841] TS 7b2592f0c1574683851129e927bde1d4 (127.13.88.195:40771): tablet 243b7913cbf24b16a41a24408b358079 (table test-table [id=c0f5d129253c4ed18bd34133fa82379e]) successfully deleted
I20260923 19:46:29.739447 32395 ts_tablet_manager.cc:1918] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:29.739516 32394 ts_tablet_manager.cc:1918] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:29.739679 32395 log.cc:1196] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/243b7913cbf24b16a41a24408b358079
I20260923 19:46:29.739755 32394 log.cc:1196] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/243b7913cbf24b16a41a24408b358079
I20260923 19:46:29.740273 32395 ts_tablet_manager.cc:1939] T 243b7913cbf24b16a41a24408b358079 P cd05e97566e94a6c9cc0f80f6c36de9e: Deleting consensus metadata
I20260923 19:46:29.740399 32394 ts_tablet_manager.cc:1939] T 243b7913cbf24b16a41a24408b358079 P 300b3763e5764727a944538afb90ede4: Deleting consensus metadata
I20260923 19:46:29.742125 31882 catalog_manager.cc:4841] TS 300b3763e5764727a944538afb90ede4 (127.13.88.194:36707): tablet 243b7913cbf24b16a41a24408b358079 (table test-table [id=c0f5d129253c4ed18bd34133fa82379e]) successfully deleted
I20260923 19:46:29.742551 31885 catalog_manager.cc:4841] TS cd05e97566e94a6c9cc0f80f6c36de9e (127.13.88.193:35403): tablet 243b7913cbf24b16a41a24408b358079 (table test-table [id=c0f5d129253c4ed18bd34133fa82379e]) successfully deleted
Sep 23 19:46:29 dist-test-slave-xg7f krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:46:29.752413 32369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.724881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49078 (local address 127.13.88.193:35403)
0923 19:46:29.725046 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.725052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.735993 (+ 10941us) server_negotiation.cc:407] Connection header received
0923 19:46:29.736460 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.736466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.736559 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.736638 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:29.738438 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.739576 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.741496 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.742130 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.742229 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.746694 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:29.746706 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:29.746720 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:29.746750 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:29.749624 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.750284 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.750291 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.750293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.750410 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.750809 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.750822 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.750824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.751228 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:29.751544 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.751863 (+ 319us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.752077 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:46:29.753001 32082 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:29.842308 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31959
I20260923 19:46:29.859824 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 32093
Sep 23 19:46:29 dist-test-slave-xg7f krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:46:29.876169 32371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.860613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39290 (local address 127.13.88.194:36707)
0923 19:46:29.860791 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.860798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.860828 (+ 30us) server_negotiation.cc:407] Connection header received
0923 19:46:29.861021 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.861032 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.861099 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.861212 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:29.862465 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.863385 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.864699 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.865113 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.865254 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.869549 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:29.869567 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:29.869588 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:29.869632 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:29.873271 (+ 3639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.874039 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.874049 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.874053 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.874206 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.874592 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.874597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.874601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.875078 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:29.875423 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.875584 (+ 161us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.875818 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:46:29.876909 32216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:29.965057 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 32093
I20260923 19:46:29.982590 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 32226
Sep 23 19:46:29 dist-test-slave-xg7f krb5kdc[31853](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:46:29.998790 32367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:29.983372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49818 (local address 127.13.88.195:40771)
0923 19:46:29.983529 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:29.983535 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:29.983571 (+ 36us) server_negotiation.cc:407] Connection header received
0923 19:46:29.983781 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:29.983785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:29.983863 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:29.983969 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:29.985171 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.985971 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.987359 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:29.987800 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:29.987947 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:29.992072 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:29.992087 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:29.992106 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:29.992159 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:29.996010 (+ 3851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.996626 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.996637 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.996641 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.996837 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:29.997192 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:29.997197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:29.997200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:29.997656 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:29.997965 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:29.998152 (+ 187us) server_negotiation.cc:299] Negotiation successful
0923 19:46:29.998377 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:46:29.999621 32349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:30.121515 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 32226
I20260923 19:46:30.140605 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 31866
I20260923 19:46:30.141636 31928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:30.249948 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 31866
2026-09-23T19:46:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4114 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-23T19:46:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:30Z Disabled control of system clock
I20260923 19:46:30.323405 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43765
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:39665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:46:30.654155 32405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:30.654417 32405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:30.654551 32405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:30.661445 32405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:30.661535 32405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:30.661602 32405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:30.661700 32405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:30.661772 32405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:30.670598 32405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43765
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:30.671945 32405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:30.673715 32405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:30.684983 32410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:30.684998 32411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:30.685041 32413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:30.685830 32405 server_base.cc:1034] running on GCE node
I20260923 19:46:30.686496 32405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:30.687865 32405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:30.689092 32405 hybrid_clock.cc:648] HybridClock initialized: now 1790192790689054 us; error 50 us; skew 500 ppm
I20260923 19:46:30.689410 32405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:30.691735 32405 webserver.cc:460] Webserver started at http://127.13.88.254:41659/ using document root <none> and password file <none>
I20260923 19:46:30.692369 32405 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:30.692487 32405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:30.692775 32405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:30.695449 32405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "650502f5054a4a0ca470ec817da282e2"
format_stamp: "Formatted at 2026-09-23 19:46:30 on dist-test-slave-xg7f"
server_key: "7fa4a9b006fd4b0b797028bb04ba517a"
server_key_iv: "ae081e7b276e654b7cbf2c5167258bda"
server_key_version: "encryptionkey@0"
I20260923 19:46:30.696216 32405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "650502f5054a4a0ca470ec817da282e2"
format_stamp: "Formatted at 2026-09-23 19:46:30 on dist-test-slave-xg7f"
server_key: "7fa4a9b006fd4b0b797028bb04ba517a"
server_key_iv: "ae081e7b276e654b7cbf2c5167258bda"
server_key_version: "encryptionkey@0"
I20260923 19:46:30.700879 32405 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:46:30.703946 32419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:30.705170 32405 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 19:46:30.705354 32405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "650502f5054a4a0ca470ec817da282e2"
format_stamp: "Formatted at 2026-09-23 19:46:30 on dist-test-slave-xg7f"
server_key: "7fa4a9b006fd4b0b797028bb04ba517a"
server_key_iv: "ae081e7b276e654b7cbf2c5167258bda"
server_key_version: "encryptionkey@0"
I20260923 19:46:30.705567 32405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:30.742274 32405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:30.743229 32405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:30.743522 32405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:30.761515 32405 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:43765
I20260923 19:46:30.761523 32470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:43765 every 8 connection(s)
I20260923 19:46:30.762876 32405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:30.764465 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 32405
I20260923 19:46:30.764650 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:30.765192 13667 external_mini_cluster.cc:1428] Setting key 558e839a2cd76121535a02912e907b50
I20260923 19:46:30.767717 32471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:30.778420 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:30.767121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48436 (local address 127.13.88.254:43765)
0923 19:46:30.768146 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:30.768158 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:30.768198 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:46:30.769861 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:30.769882 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:30.770338 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:30.770752 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:30.771322 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:30.772634 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:30.773979 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:30.774643 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:30.774835 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:30.776116 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:30.776126 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:30.776140 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:30.776721 (+ 581us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:30.776809 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:30.776839 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:30.776963 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:30.777201 (+ 238us) server_negotiation.cc:299] Negotiation successful
0923 19:46:30.777505 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":347,"threads_started":1}
I20260923 19:46:30.778573 32471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2: Bootstrap starting.
I20260923 19:46:30.781746 32471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:30.782879 32471 log.cc:824] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:30.785586 32471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2: No bootstrap required, opened a new log
I20260923 19:46:30.792941 32471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650502f5054a4a0ca470ec817da282e2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43765 } }
I20260923 19:46:30.793287 32471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:30.793391 32471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 650502f5054a4a0ca470ec817da282e2, State: Initialized, Role: FOLLOWER
I20260923 19:46:30.793953 32471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650502f5054a4a0ca470ec817da282e2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43765 } }
I20260923 19:46:30.794183 32471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:30.794317 32471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:30.794480 32471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:30.796873 32471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650502f5054a4a0ca470ec817da282e2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43765 } }
I20260923 19:46:30.797333 32471 leader_election.cc:302] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 650502f5054a4a0ca470ec817da282e2; no voters:
I20260923 19:46:30.797876 32471 leader_election.cc:288] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:30.798010 32476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:30.798730 32476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [term 1 LEADER]: Becoming Leader. State: Replica: 650502f5054a4a0ca470ec817da282e2, State: Running, Role: LEADER
I20260923 19:46:30.799304 32476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650502f5054a4a0ca470ec817da282e2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43765 } }
I20260923 19:46:30.799870 32471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:30.802049 32477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "650502f5054a4a0ca470ec817da282e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650502f5054a4a0ca470ec817da282e2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43765 } } }
I20260923 19:46:30.802412 32478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 650502f5054a4a0ca470ec817da282e2. Latest consensus state: current_term: 1 leader_uuid: "650502f5054a4a0ca470ec817da282e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650502f5054a4a0ca470ec817da282e2" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43765 } } }
I20260923 19:46:30.802841 32478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:30.802851 32477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:30.807647 32484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:30.813200 32484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:30.821138 32484 catalog_manager.cc:1347] Generated new cluster ID: 5222bf366bf34b3986c976390a30127b
I20260923 19:46:30.821240 32484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:30.849047 32484 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:30.850845 32484 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:30.867661 32484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2: Generated new TSK 0
I20260923 19:46:30.868674 32484 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:30.874773 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43765
--builtin_ntp_servers=127.13.88.212:39665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:46:31.197016 32495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:31.197325 32495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:31.197492 32495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:31.204668 32495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:31.204808 32495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:31.204988 32495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:46:31.214134 32495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:31.215422 32495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:31.217195 32495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:31.229926 32503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:31.229895 32501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:31.230029 32500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:31.230899 32495 server_base.cc:1034] running on GCE node
I20260923 19:46:31.231575 32495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:31.232436 32495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:31.233626 32495 hybrid_clock.cc:648] HybridClock initialized: now 1790192791233572 us; error 52 us; skew 500 ppm
I20260923 19:46:31.233944 32495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:31.236104 32495 webserver.cc:460] Webserver started at http://127.13.88.193:36279/ using document root <none> and password file <none>
I20260923 19:46:31.236764 32495 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:31.236873 32495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:31.237210 32495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:31.240109 32495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "12fccc7f6512428c99ef1b621c046218"
format_stamp: "Formatted at 2026-09-23 19:46:31 on dist-test-slave-xg7f"
server_key: "e5ad58281869cbe7747242999613a65b"
server_key_iv: "c4feee3621f87f4d256352b60f615388"
server_key_version: "encryptionkey@0"
I20260923 19:46:31.240880 32495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "12fccc7f6512428c99ef1b621c046218"
format_stamp: "Formatted at 2026-09-23 19:46:31 on dist-test-slave-xg7f"
server_key: "e5ad58281869cbe7747242999613a65b"
server_key_iv: "c4feee3621f87f4d256352b60f615388"
server_key_version: "encryptionkey@0"
I20260923 19:46:31.245599 32495 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260923 19:46:31.248955 32509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:31.250157 32495 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 19:46:31.250340 32495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "12fccc7f6512428c99ef1b621c046218"
format_stamp: "Formatted at 2026-09-23 19:46:31 on dist-test-slave-xg7f"
server_key: "e5ad58281869cbe7747242999613a65b"
server_key_iv: "c4feee3621f87f4d256352b60f615388"
server_key_version: "encryptionkey@0"
I20260923 19:46:31.250550 32495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:31.272055 32495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:31.272881 32495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:31.273181 32495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:31.274129 32495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:31.275609 32495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:31.275733 32495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:31.275851 32495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:31.275938 32495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:31.309128 32495 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:40757
I20260923 19:46:31.309212 32621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:40757 every 8 connection(s)
I20260923 19:46:31.310567 32495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:46:31.320873 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 32495
I20260923 19:46:31.321045 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:46:31.321560 13667 external_mini_cluster.cc:1428] Setting key cf8772023243e1cd5e5868b3bc398c71
I20260923 19:46:31.322533 32624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:31.313146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:50047 (local address 127.13.88.254:43765)
0923 19:46:31.313604 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:31.313611 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:31.314935 (+ 1324us) server_negotiation.cc:407] Connection header received
0923 19:46:31.316646 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:31.316650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:31.316712 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:31.316815 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:31.317766 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.318469 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.319956 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.320344 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.320436 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:31.321729 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:31.321735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:31.321739 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:31.321761 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:31.321818 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:31.321836 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:31.321931 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:31.322129 (+ 198us) server_negotiation.cc:299] Negotiation successful
0923 19:46:31.322222 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":223,"threads_started":1}
I20260923 19:46:31.323690 32625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:31.313730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43765 (local address 127.13.88.193:50047)
0923 19:46:31.314778 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:31.314826 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:31.316418 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:31.316989 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:31.316997 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:31.317076 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:31.317633 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:31.317649 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.318587 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.318590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:31.319837 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:31.319849 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.320522 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.320526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:31.320715 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:31.321422 (+ 707us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:31.321424 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:31.321460 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:31.321534 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:31.321930 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:31.321938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:31.321943 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:46:31.322078 (+ 135us) client_negotiation.cc:240] Negotiation successful
0923 19:46:31.322469 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":352,"threads_started":1}
I20260923 19:46:31.324621 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43765
--builtin_ntp_servers=127.13.88.212:39665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:46:31.325234 32622 heartbeater.cc:347] Connected to a master server at 127.13.88.254:43765
I20260923 19:46:31.325551 32622 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:31.326428 32622 heartbeater.cc:511] Master 127.13.88.254:43765 requested a full tablet report, sending...
I20260923 19:46:31.328527 32436 ts_manager.cc:194] Registered new tserver with Master: 12fccc7f6512428c99ef1b621c046218 (127.13.88.193:40757)
I20260923 19:46:31.329982 32436 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.193:50047
W20260923 19:46:31.641911 32626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:31.642167 32626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:31.642248 32626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:31.649394 32626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:31.649494 32626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:31.649596 32626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:46:31.658831 32626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:31.660157 32626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:31.661803 32626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:31.679690 32632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:31.679960 32634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:31.680338 32631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:31.680617 32626 server_base.cc:1034] running on GCE node
I20260923 19:46:31.681195 32626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:31.682081 32626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:31.683264 32626 hybrid_clock.cc:648] HybridClock initialized: now 1790192791683204 us; error 50 us; skew 500 ppm
I20260923 19:46:31.683564 32626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:31.685729 32626 webserver.cc:460] Webserver started at http://127.13.88.194:37513/ using document root <none> and password file <none>
I20260923 19:46:31.686398 32626 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:31.686509 32626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:31.686831 32626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:31.689673 32626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "9022b0b8a93749cf92f3d7b85ca4e00b"
format_stamp: "Formatted at 2026-09-23 19:46:31 on dist-test-slave-xg7f"
server_key: "e2e5a82735fbfdf4ef9a336d8d455be7"
server_key_iv: "1851055b5235ced5e4772b3ecd6675c4"
server_key_version: "encryptionkey@0"
I20260923 19:46:31.690438 32626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "9022b0b8a93749cf92f3d7b85ca4e00b"
format_stamp: "Formatted at 2026-09-23 19:46:31 on dist-test-slave-xg7f"
server_key: "e2e5a82735fbfdf4ef9a336d8d455be7"
server_key_iv: "1851055b5235ced5e4772b3ecd6675c4"
server_key_version: "encryptionkey@0"
I20260923 19:46:31.695258 32626 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260923 19:46:31.698438 32640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:31.699772 32626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:31.699949 32626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "9022b0b8a93749cf92f3d7b85ca4e00b"
format_stamp: "Formatted at 2026-09-23 19:46:31 on dist-test-slave-xg7f"
server_key: "e2e5a82735fbfdf4ef9a336d8d455be7"
server_key_iv: "1851055b5235ced5e4772b3ecd6675c4"
server_key_version: "encryptionkey@0"
I20260923 19:46:31.700161 32626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:31.716107 32626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:31.716881 32626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:31.717172 32626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:31.718037 32626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:31.719538 32626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:31.719655 32626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:31.719789 32626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:31.719870 32626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:31.751397 32626 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:40113
I20260923 19:46:31.751477 32752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:40113 every 8 connection(s)
I20260923 19:46:31.752723 32626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:46:31.759750 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 32626
I20260923 19:46:31.759943 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:46:31.760492 13667 external_mini_cluster.cc:1428] Setting key c8cf820d1fd1d7dec5b01947a76f71cd
I20260923 19:46:31.763191 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43765
--builtin_ntp_servers=127.13.88.212:39665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:46:31.766731 32624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:31.755378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:45413 (local address 127.13.88.254:43765)
0923 19:46:31.755548 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:31.755553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:31.756917 (+ 1364us) server_negotiation.cc:407] Connection header received
0923 19:46:31.758540 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:31.758544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:31.758608 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:31.758692 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:31.759743 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.760891 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.763219 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.763989 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.764136 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:31.765738 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:31.765747 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:31.765755 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:31.765779 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:31.765822 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:31.765840 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:31.765933 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:31.766185 (+ 252us) server_negotiation.cc:299] Negotiation successful
0923 19:46:31.766313 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:46:31.767911 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:31.755930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43765 (local address 127.13.88.194:45413)
0923 19:46:31.756757 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:31.756796 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:31.758310 (+ 1514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:31.758886 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:31.758894 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:31.758973 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:31.759573 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:31.759589 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.761129 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.761135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:31.763026 (+ 1891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:31.763040 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:31.764236 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:31.764243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:31.764554 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:31.765358 (+ 804us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:31.765362 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:31.765421 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:31.765519 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:31.765946 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:31.765957 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:31.765965 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 19:46:31.766155 (+ 190us) client_negotiation.cc:240] Negotiation successful
0923 19:46:31.766588 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":249,"threads_started":1}
I20260923 19:46:31.769425 32753 heartbeater.cc:347] Connected to a master server at 127.13.88.254:43765
I20260923 19:46:31.769747 32753 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:31.770660 32753 heartbeater.cc:511] Master 127.13.88.254:43765 requested a full tablet report, sending...
I20260923 19:46:31.772423 32436 ts_manager.cc:194] Registered new tserver with Master: 9022b0b8a93749cf92f3d7b85ca4e00b (127.13.88.194:40113)
I20260923 19:46:31.773262 32436 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.194:45413
W20260923 19:46:32.096313 32756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:32.096591 32756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:32.096678 32756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:32.104177 32756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:32.104267 32756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:32.104377 32756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:46:32.113598 32756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:39665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:32.114820 32756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:32.116559 32756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:32.129508 32764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:32.129591 32761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:32.129563 32762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:32.130569 32756 server_base.cc:1034] running on GCE node
I20260923 19:46:32.131217 32756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:32.132136 32756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:32.133353 32756 hybrid_clock.cc:648] HybridClock initialized: now 1790192792133268 us; error 47 us; skew 500 ppm
I20260923 19:46:32.133661 32756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:32.135875 32756 webserver.cc:460] Webserver started at http://127.13.88.195:45505/ using document root <none> and password file <none>
I20260923 19:46:32.136552 32756 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:32.136670 32756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:32.136991 32756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:32.139827 32756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "f7ad7bf82d4244acb855e54d8238f155"
format_stamp: "Formatted at 2026-09-23 19:46:32 on dist-test-slave-xg7f"
server_key: "7b6760f732b578d478690c2b0069c8f2"
server_key_iv: "35d0a10fc53a27a41ff94a24b1b3c464"
server_key_version: "encryptionkey@0"
I20260923 19:46:32.140625 32756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "f7ad7bf82d4244acb855e54d8238f155"
format_stamp: "Formatted at 2026-09-23 19:46:32 on dist-test-slave-xg7f"
server_key: "7b6760f732b578d478690c2b0069c8f2"
server_key_iv: "35d0a10fc53a27a41ff94a24b1b3c464"
server_key_version: "encryptionkey@0"
I20260923 19:46:32.145583 32756 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:46:32.148914 302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:32.150146 32756 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 19:46:32.150321 32756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "f7ad7bf82d4244acb855e54d8238f155"
format_stamp: "Formatted at 2026-09-23 19:46:32 on dist-test-slave-xg7f"
server_key: "7b6760f732b578d478690c2b0069c8f2"
server_key_iv: "35d0a10fc53a27a41ff94a24b1b3c464"
server_key_version: "encryptionkey@0"
I20260923 19:46:32.150542 32756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:32.167740 32756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:32.168572 32756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:32.168888 32756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:32.169836 32756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:32.171331 32756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:32.171455 32756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:32.171584 32756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:32.171670 32756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:32.204510 32756 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:38027
I20260923 19:46:32.204555 414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:38027 every 8 connection(s)
I20260923 19:46:32.205806 32756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:46:32.211457 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 32756
I20260923 19:46:32.211637 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:46:32.212113 13667 external_mini_cluster.cc:1428] Setting key 514d4add189f52fe524326012a43e2d8
I20260923 19:46:32.218307 32624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.208340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:57185 (local address 127.13.88.254:43765)
0923 19:46:32.208556 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.208563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.210212 (+ 1649us) server_negotiation.cc:407] Connection header received
0923 19:46:32.212088 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.212095 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.212183 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.212293 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:32.213285 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.214090 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.215700 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.216118 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.216252 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.217501 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:32.217506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:32.217509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:32.217526 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:32.217555 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:32.217567 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:32.217662 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.217875 (+ 213us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.217967 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:46:32.219341 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.208976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43765 (local address 127.13.88.195:57185)
0923 19:46:32.210046 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:32.210081 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:32.211813 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:32.212472 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:32.212480 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:32.212590 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:32.213123 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.213138 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.214235 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.214245 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.215552 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.215563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.216337 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.216344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.216578 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.217193 (+ 615us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:32.217196 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:32.217234 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:32.217306 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:32.217658 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:32.217668 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:32.217679 (+ 11us) client_negotiation.cc:769] Sending connection context
0923 19:46:32.217859 (+ 180us) client_negotiation.cc:240] Negotiation successful
0923 19:46:32.218241 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":288,"threads_started":1}
I20260923 19:46:32.220667 415 heartbeater.cc:347] Connected to a master server at 127.13.88.254:43765
I20260923 19:46:32.220957 415 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:32.221671 415 heartbeater.cc:511] Master 127.13.88.254:43765 requested a full tablet report, sending...
I20260923 19:46:32.222914 32436 ts_manager.cc:194] Registered new tserver with Master: f7ad7bf82d4244acb855e54d8238f155 (127.13.88.195:38027)
I20260923 19:46:32.223680 32436 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.195:57185
I20260923 19:46:32.226933 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:46:32.236466 32624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.230866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38076 (local address 127.13.88.254:43765)
0923 19:46:32.231019 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.231023 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.231507 (+ 484us) server_negotiation.cc:407] Connection header received
0923 19:46:32.231631 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.231635 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.231702 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.231778 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:32.232253 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.232940 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.234323 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.234702 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.234787 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.235873 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:32.235878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:32.235881 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:32.235898 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:32.235928 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:32.235940 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:32.236049 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.236201 (+ 152us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.236244 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:46:32.240284 32436 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:46:32.246914 32436 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:46:32.273641 428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.258773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40757 (local address 127.0.0.1:39798)
0923 19:46:32.264111 (+ 5338us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:32.264173 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:32.264437 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:32.265565 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:32.265576 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:32.265624 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:32.266005 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.266022 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.267726 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.267731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.270562 (+ 2831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.270578 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.272675 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.272679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.272790 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.272821 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 19:46:32.272977 (+ 156us) client_negotiation.cc:240] Negotiation successful
0923 19:46:32.273188 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5034,"mutex_wait_us":4,"spinlock_wait_cycles":4608,"thread_start_us":4975,"threads_started":1}
I20260923 19:46:32.273921 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.258900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39798 (local address 127.13.88.193:40757)
0923 19:46:32.263585 (+ 4685us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.263595 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.264279 (+ 684us) server_negotiation.cc:407] Connection header received
0923 19:46:32.264695 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.264704 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.264958 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.265137 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:32.266220 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.267598 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.270787 (+ 3189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.272156 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.272274 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.272567 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.273018 (+ 451us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.273188 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4520,"thread_start_us":4418,"threads_started":1}
I20260923 19:46:32.274008 432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.264831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32806 (local address 127.13.88.195:38027)
0923 19:46:32.266035 (+ 1204us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.266040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.266066 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:46:32.266177 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.266183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.266407 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.266603 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:32.267219 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.269008 (+ 1789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.271023 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.272403 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.272528 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.272783 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.273513 (+ 730us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.273669 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1079,"thread_start_us":1529,"threads_started":1}
I20260923 19:46:32.274219 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.259564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43978 (local address 127.13.88.194:40113)
0923 19:46:32.260278 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.260291 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.264279 (+ 3988us) server_negotiation.cc:407] Connection header received
0923 19:46:32.265734 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.265742 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.265985 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.266162 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:32.266749 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.268303 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.270954 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.272403 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.272528 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.272756 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.273724 (+ 968us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.273892 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":344,"threads_started":1}
I20260923 19:46:32.274502 427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.258833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:40113 (local address 127.0.0.1:43978)
0923 19:46:32.264111 (+ 5278us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:32.264168 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:32.264437 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:32.266168 (+ 1731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:32.266172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:32.266197 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:32.266539 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.266555 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.268454 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.268459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.270782 (+ 2323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.270792 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.272904 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.272911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.273215 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.273339 (+ 124us) client_negotiation.cc:769] Sending connection context
0923 19:46:32.273420 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 19:46:32.273556 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5081,"mutex_wait_us":117,"spinlock_wait_cycles":10240,"thread_start_us":4807,"threads_started":1}
I20260923 19:46:32.274896 431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.264528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:38027 (local address 127.0.0.1:32806)
0923 19:46:32.265083 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:32.265098 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:32.265205 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:32.266623 (+ 1418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:32.266627 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:32.266651 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:32.267015 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.267026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.269140 (+ 2114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.269144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.270777 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.270790 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.272954 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.272959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.273212 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.273340 (+ 128us) client_negotiation.cc:769] Sending connection context
0923 19:46:32.273421 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 19:46:32.274510 (+ 1089us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":1094,"thread_start_us":330,"threads_started":1}
I20260923 19:46:32.277890 350 tablet_service.cc:1467] Processing CreateTablet for tablet cc49d3b136d548f2b6789a0cb381858a (DEFAULT_TABLE table=test-table [id=3eda555b2da64005aca3d5c9baaa283b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:32.278048 32688 tablet_service.cc:1467] Processing CreateTablet for tablet cc49d3b136d548f2b6789a0cb381858a (DEFAULT_TABLE table=test-table [id=3eda555b2da64005aca3d5c9baaa283b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:32.278048 32557 tablet_service.cc:1467] Processing CreateTablet for tablet cc49d3b136d548f2b6789a0cb381858a (DEFAULT_TABLE table=test-table [id=3eda555b2da64005aca3d5c9baaa283b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:32.279348 32557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc49d3b136d548f2b6789a0cb381858a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:32.279343 350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc49d3b136d548f2b6789a0cb381858a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:32.279392 32688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc49d3b136d548f2b6789a0cb381858a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:32.290745 433 tablet_bootstrap.cc:492] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Bootstrap starting.
I20260923 19:46:32.293326 435 tablet_bootstrap.cc:492] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Bootstrap starting.
I20260923 19:46:32.294075 433 tablet_bootstrap.cc:654] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:32.294135 434 tablet_bootstrap.cc:492] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Bootstrap starting.
I20260923 19:46:32.295369 433 log.cc:824] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:32.297637 435 tablet_bootstrap.cc:654] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:32.297677 434 tablet_bootstrap.cc:654] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:32.298732 433 tablet_bootstrap.cc:492] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: No bootstrap required, opened a new log
I20260923 19:46:32.298964 435 log.cc:824] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:32.298990 434 log.cc:824] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:32.299065 433 ts_tablet_manager.cc:1397] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20260923 19:46:32.301950 434 tablet_bootstrap.cc:492] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: No bootstrap required, opened a new log
I20260923 19:46:32.302124 435 tablet_bootstrap.cc:492] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: No bootstrap required, opened a new log
I20260923 19:46:32.302246 434 ts_tablet_manager.cc:1397] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260923 19:46:32.302381 435 ts_tablet_manager.cc:1397] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260923 19:46:32.309690 433 raft_consensus.cc:348] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.310304 433 raft_consensus.cc:374] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:32.310418 433 raft_consensus.cc:729] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7ad7bf82d4244acb855e54d8238f155, State: Initialized, Role: FOLLOWER
I20260923 19:46:32.310855 434 raft_consensus.cc:348] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.311215 434 raft_consensus.cc:374] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:32.311137 433 consensus_queue.cc:260] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.311311 434 raft_consensus.cc:729] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9022b0b8a93749cf92f3d7b85ca4e00b, State: Initialized, Role: FOLLOWER
I20260923 19:46:32.311832 434 consensus_queue.cc:260] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.312958 32753 heartbeater.cc:503] Master 127.13.88.254:43765 was elected leader, sending a full tablet report...
I20260923 19:46:32.313444 434 ts_tablet_manager.cc:1428] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260923 19:46:32.319725 415 heartbeater.cc:503] Master 127.13.88.254:43765 was elected leader, sending a full tablet report...
I20260923 19:46:32.320713 433 ts_tablet_manager.cc:1428] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Time spent starting tablet: real 0.021s user 0.018s sys 0.000s
I20260923 19:46:32.323968 435 raft_consensus.cc:348] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.324429 435 raft_consensus.cc:374] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:32.324553 435 raft_consensus.cc:729] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12fccc7f6512428c99ef1b621c046218, State: Initialized, Role: FOLLOWER
I20260923 19:46:32.325150 435 consensus_queue.cc:260] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.326155 32622 heartbeater.cc:503] Master 127.13.88.254:43765 was elected leader, sending a full tablet report...
I20260923 19:46:32.326788 435 ts_tablet_manager.cc:1428] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Time spent starting tablet: real 0.024s user 0.015s sys 0.000s
W20260923 19:46:32.457556 416 tablet.cc:2369] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:46:32.500841 439 raft_consensus.cc:482] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:32.501149 439 raft_consensus.cc:504] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.502864 439 leader_election.cc:288] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12fccc7f6512428c99ef1b621c046218 (127.13.88.193:40757), 9022b0b8a93749cf92f3d7b85ca4e00b (127.13.88.194:40113)
W20260923 19:46:32.504793 32754 tablet.cc:2369] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:46:32.510479 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.503624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:37173 (local address 127.13.88.194:40113)
0923 19:46:32.503824 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.503831 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.503853 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:46:32.503930 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.503935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.504031 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.504124 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:32.504647 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.505655 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.508223 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.509477 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.509639 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.509719 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.510091 (+ 372us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.510219 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:46:32.510479 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.503285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:40727 (local address 127.13.88.193:40757)
0923 19:46:32.503487 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.503493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.504110 (+ 617us) server_negotiation.cc:407] Connection header received
0923 19:46:32.504247 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.504251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.504333 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.504436 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:32.505104 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.506043 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.508460 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.509624 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.509743 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.509862 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.510131 (+ 269us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.510243 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:46:32.510515 417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.503189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:40113 (local address 127.13.88.195:37173)
0923 19:46:32.503413 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:32.503437 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:32.503582 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:32.504205 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:32.504210 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:32.504238 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:32.504474 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.504486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.505826 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.505831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.508074 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.508089 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.509689 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.509697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.509884 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.509919 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 19:46:32.510045 (+ 126us) client_negotiation.cc:240] Negotiation successful
0923 19:46:32.510185 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":101}
I20260923 19:46:32.510538 442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.503240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:40757 (local address 127.13.88.195:40727)
0923 19:46:32.503979 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:32.503996 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:32.504122 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:32.504488 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:32.504492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:32.504524 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:32.504905 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.504918 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.506189 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.506195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.508293 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:32.508302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.509822 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.509831 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:32.509980 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.510019 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 19:46:32.510092 (+ 73us) client_negotiation.cc:240] Negotiation successful
0923 19:46:32.510184 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":392,"threads_started":1}
I20260923 19:46:32.511675 32708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc49d3b136d548f2b6789a0cb381858a" candidate_uuid: "f7ad7bf82d4244acb855e54d8238f155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" is_pre_election: true
I20260923 19:46:32.511788 32577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc49d3b136d548f2b6789a0cb381858a" candidate_uuid: "f7ad7bf82d4244acb855e54d8238f155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12fccc7f6512428c99ef1b621c046218" is_pre_election: true
I20260923 19:46:32.512230 32708 raft_consensus.cc:2454] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7ad7bf82d4244acb855e54d8238f155 in term 0.
I20260923 19:46:32.512323 32577 raft_consensus.cc:2454] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7ad7bf82d4244acb855e54d8238f155 in term 0.
I20260923 19:46:32.512887 306 leader_election.cc:302] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9022b0b8a93749cf92f3d7b85ca4e00b, f7ad7bf82d4244acb855e54d8238f155; no voters:
I20260923 19:46:32.513262 439 raft_consensus.cc:2781] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:46:32.513401 439 raft_consensus.cc:482] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:46:32.513502 439 raft_consensus.cc:3037] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:32.515663 439 raft_consensus.cc:504] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.516276 439 leader_election.cc:288] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [CANDIDATE]: Term 1 election: Requested vote from peers 12fccc7f6512428c99ef1b621c046218 (127.13.88.193:40757), 9022b0b8a93749cf92f3d7b85ca4e00b (127.13.88.194:40113)
I20260923 19:46:32.516671 32577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc49d3b136d548f2b6789a0cb381858a" candidate_uuid: "f7ad7bf82d4244acb855e54d8238f155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12fccc7f6512428c99ef1b621c046218"
I20260923 19:46:32.516742 32708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc49d3b136d548f2b6789a0cb381858a" candidate_uuid: "f7ad7bf82d4244acb855e54d8238f155" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b"
I20260923 19:46:32.516889 32577 raft_consensus.cc:3037] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:32.516933 32708 raft_consensus.cc:3037] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:32.520046 32577 raft_consensus.cc:2454] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7ad7bf82d4244acb855e54d8238f155 in term 1.
I20260923 19:46:32.520046 32708 raft_consensus.cc:2454] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7ad7bf82d4244acb855e54d8238f155 in term 1.
I20260923 19:46:32.520447 304 leader_election.cc:302] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12fccc7f6512428c99ef1b621c046218, f7ad7bf82d4244acb855e54d8238f155; no voters:
I20260923 19:46:32.520732 439 raft_consensus.cc:2781] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:32.521193 439 raft_consensus.cc:686] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 1 LEADER]: Becoming Leader. State: Replica: f7ad7bf82d4244acb855e54d8238f155, State: Running, Role: LEADER
I20260923 19:46:32.521638 439 consensus_queue.cc:237] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } }
I20260923 19:46:32.525906 32435 catalog_manager.cc:5495] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7ad7bf82d4244acb855e54d8238f155 (127.13.88.195). New cstate: current_term: 1 leader_uuid: "f7ad7bf82d4244acb855e54d8238f155" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7ad7bf82d4244acb855e54d8238f155" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 38027 } health_report { overall_health: HEALTHY } } }
W20260923 19:46:32.563324 32623 tablet.cc:2369] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:46:32.574882 432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.570164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32820 (local address 127.13.88.195:38027)
0923 19:46:32.570322 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.570326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.570341 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:46:32.570427 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.570430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.570513 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.570632 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:46:32.570997 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.571694 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.572968 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.573341 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.573432 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.573904 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:46:32.574409 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:46:32.574534 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.574663 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.574698 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:46:32.583211 32708 raft_consensus.cc:1261] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 1 FOLLOWER]: Refusing update from remote peer f7ad7bf82d4244acb855e54d8238f155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:32.583211 32577 raft_consensus.cc:1261] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 1 FOLLOWER]: Refusing update from remote peer f7ad7bf82d4244acb855e54d8238f155: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:32.584309 443 consensus_queue.cc:1035] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9022b0b8a93749cf92f3d7b85ca4e00b" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:32.584656 439 consensus_queue.cc:1035] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12fccc7f6512428c99ef1b621c046218" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:32.595790 446 mvcc.cc:205] Tried to move back new op lower bound from 7332629678410199040 to 7332629678172209152. Current Snapshot: MvccSnapshot[applied={T|T < 7332629678410199040}]
I20260923 19:46:32.610360 32436 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:32.610622 32436 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:32.614359 32436 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 650502f5054a4a0ca470ec817da282e2: Sending DeleteTablet for 3 replicas of tablet cc49d3b136d548f2b6789a0cb381858a
I20260923 19:46:32.615547 32557 tablet_service.cc:1514] Processing DeleteTablet for tablet cc49d3b136d548f2b6789a0cb381858a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:32 UTC) from {username='slave'} at 127.0.0.1:39798
I20260923 19:46:32.615723 350 tablet_service.cc:1514] Processing DeleteTablet for tablet cc49d3b136d548f2b6789a0cb381858a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:32 UTC) from {username='slave'} at 127.0.0.1:32806
I20260923 19:46:32.616428 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 32495
I20260923 19:46:32.616715 32688 tablet_service.cc:1514] Processing DeleteTablet for tablet cc49d3b136d548f2b6789a0cb381858a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:32 UTC) from {username='slave'} at 127.0.0.1:43978
I20260923 19:46:32.628309 456 tablet_replica.cc:330] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: stopping tablet replica
I20260923 19:46:32.629065 456 raft_consensus.cc:2229] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:32.629757 456 raft_consensus.cc:2258] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:32.632545 456 ts_tablet_manager.cc:1905] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:32.635828 458 tablet_replica.cc:330] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: stopping tablet replica
I20260923 19:46:32.635994 457 tablet_replica.cc:330] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: stopping tablet replica
I20260923 19:46:32.636303 458 raft_consensus.cc:2229] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:32.636420 457 raft_consensus.cc:2229] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:46:32.636811 458 raft_consensus.cc:2258] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:32.637111 457 raft_consensus.cc:2258] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:32.639578 457 ts_tablet_manager.cc:1905] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:32.640496 456 ts_tablet_manager.cc:1918] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:32.640725 456 log.cc:1196] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/cc49d3b136d548f2b6789a0cb381858a
I20260923 19:46:32.640743 458 ts_tablet_manager.cc:1905] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:32.641350 456 ts_tablet_manager.cc:1939] T cc49d3b136d548f2b6789a0cb381858a P 12fccc7f6512428c99ef1b621c046218: Deleting consensus metadata
I20260923 19:46:32.643074 429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.618252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39806 (local address 127.13.88.193:40757)
0923 19:46:32.618478 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.618487 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.629426 (+ 10939us) server_negotiation.cc:407] Connection header received
0923 19:46:32.629991 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.630000 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.630164 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.630259 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:32.631155 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.632673 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.637240 (+ 4567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.638017 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.638127 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.641346 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:32.641359 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:32.641376 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:32.642150 (+ 774us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:32.642214 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:32.642243 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:32.642340 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.642584 (+ 244us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.642699 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:46:32.643450 32421 catalog_manager.cc:4841] TS 12fccc7f6512428c99ef1b621c046218 (127.13.88.193:40757): tablet cc49d3b136d548f2b6789a0cb381858a (table test-table [id=3eda555b2da64005aca3d5c9baaa283b]) successfully deleted
I20260923 19:46:32.644388 32617 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:32.647007 457 ts_tablet_manager.cc:1918] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:32.647269 457 log.cc:1196] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/cc49d3b136d548f2b6789a0cb381858a
I20260923 19:46:32.647924 457 ts_tablet_manager.cc:1939] T cc49d3b136d548f2b6789a0cb381858a P f7ad7bf82d4244acb855e54d8238f155: Deleting consensus metadata
I20260923 19:46:32.649786 32423 catalog_manager.cc:4841] TS f7ad7bf82d4244acb855e54d8238f155 (127.13.88.195:38027): tablet cc49d3b136d548f2b6789a0cb381858a (table test-table [id=3eda555b2da64005aca3d5c9baaa283b]) successfully deleted
I20260923 19:46:32.650748 458 ts_tablet_manager.cc:1918] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:32.650934 458 log.cc:1196] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/cc49d3b136d548f2b6789a0cb381858a
I20260923 19:46:32.651432 458 ts_tablet_manager.cc:1939] T cc49d3b136d548f2b6789a0cb381858a P 9022b0b8a93749cf92f3d7b85ca4e00b: Deleting consensus metadata
I20260923 19:46:32.652830 32423 catalog_manager.cc:4841] TS 9022b0b8a93749cf92f3d7b85ca4e00b (127.13.88.194:40113): tablet cc49d3b136d548f2b6789a0cb381858a (table test-table [id=3eda555b2da64005aca3d5c9baaa283b]) successfully deleted
I20260923 19:46:32.742903 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 32495
I20260923 19:46:32.760962 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 32626
I20260923 19:46:32.770401 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.762404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.13.88.194:40113)
0923 19:46:32.762559 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.762565 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.762581 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:46:32.762638 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.762643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.762747 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.762832 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:32.763408 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.764457 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.766250 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.766906 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.767016 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.768394 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:32.768405 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:32.768423 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:32.769154 (+ 731us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:32.769210 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:32.769234 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:32.769342 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.769931 (+ 589us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.770034 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:46:32.771369 32748 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:32.887029 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 32626
I20260923 19:46:32.905349 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 32756
I20260923 19:46:32.913273 432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:32.906186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32822 (local address 127.13.88.195:38027)
0923 19:46:32.906359 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:32.906364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:32.906419 (+ 55us) server_negotiation.cc:407] Connection header received
0923 19:46:32.906633 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:32.906637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:32.906722 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:32.906804 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:32.907440 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.908205 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.910033 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:32.910467 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:32.910559 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:32.911878 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:32.911886 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:32.911900 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:32.912504 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:32.912550 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:32.912569 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:32.912649 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:32.912820 (+ 171us) server_negotiation.cc:299] Negotiation successful
0923 19:46:32.912900 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:46:32.914018 410 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:33.033138 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 32756
I20260923 19:46:33.052528 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 32405
I20260923 19:46:33.053687 32466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:33.163656 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 32405
2026-09-23T19:46:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2913 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:33 dist-test-slave-xg7f krb5kdc[466](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:33 dist-test-slave-xg7f krb5kdc[466](info): set up 2 sockets
Sep 23 19:46:33 dist-test-slave-xg7f krb5kdc[466](info): commencing operation
krb5kdc: starting...
W20260923 19:46:34.259354 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:34 dist-test-slave-xg7f krb5kdc[466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:46:34.485925 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43795
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:34.804270 479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:34.804549 479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:34.804682 479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:34.811810 479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:34.811909 479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:34.812019 479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:34.812124 479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:34.812187 479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:34.821841 479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:34.823174 479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:34.824530 479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:34.839671 484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:34.839668 485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:34.840094 487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:34.841296 479 server_base.cc:1034] running on GCE node
I20260923 19:46:34.842043 479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:34.843443 479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:34.844663 479 hybrid_clock.cc:648] HybridClock initialized: now 1790192794844625 us; error 50 us; skew 500 ppm
I20260923 19:46:34.845011 479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:34 dist-test-slave-xg7f krb5kdc[466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192794, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:34.853684 479 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:46:34.855266 479 webserver.cc:460] Webserver started at http://127.13.88.254:37943/ using document root <none> and password file <none>
I20260923 19:46:34.855984 479 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:34.856130 479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:34.856437 479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:34.859472 479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "03d559a47bc54dffa11bd4e0e3aba48a"
format_stamp: "Formatted at 2026-09-23 19:46:34 on dist-test-slave-xg7f"
server_key: "2f1ba08062751caec00e042147b440df"
server_key_iv: "323d1cc918d8765352a2e1b2cf314c9d"
server_key_version: "encryptionkey@0"
I20260923 19:46:34.860208 479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "03d559a47bc54dffa11bd4e0e3aba48a"
format_stamp: "Formatted at 2026-09-23 19:46:34 on dist-test-slave-xg7f"
server_key: "2f1ba08062751caec00e042147b440df"
server_key_iv: "323d1cc918d8765352a2e1b2cf314c9d"
server_key_version: "encryptionkey@0"
I20260923 19:46:34.865017 479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260923 19:46:34.868321 494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:34.869550 479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:46:34.869727 479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "03d559a47bc54dffa11bd4e0e3aba48a"
format_stamp: "Formatted at 2026-09-23 19:46:34 on dist-test-slave-xg7f"
server_key: "2f1ba08062751caec00e042147b440df"
server_key_iv: "323d1cc918d8765352a2e1b2cf314c9d"
server_key_version: "encryptionkey@0"
I20260923 19:46:34.869916 479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:34.886132 479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:34.890509 479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:34.890805 479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:34.909171 479 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:43795
I20260923 19:46:34.909194 545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:43795 every 8 connection(s)
I20260923 19:46:34.910530 479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:34.914211 546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:34.918368 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 479
I20260923 19:46:34.918572 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:34.918998 13667 external_mini_cluster.cc:1428] Setting key 05318aaa485f3684ea242e0b6d9e6af5
I20260923 19:46:34.925082 546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a: Bootstrap starting.
I20260923 19:46:34.928702 546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:34.929842 546 log.cc:824] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:34.933156 546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a: No bootstrap required, opened a new log
Sep 23 19:46:34 dist-test-slave-xg7f krb5kdc[466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:34.940765 546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43795 } }
I20260923 19:46:34.941214 546 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:34.941335 546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d559a47bc54dffa11bd4e0e3aba48a, State: Initialized, Role: FOLLOWER
I20260923 19:46:34.941944 546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43795 } }
I20260923 19:46:34.942163 546 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:34.942198 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:34.920865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33202 (local address 127.13.88.254:43795)
0923 19:46:34.921671 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:34.921682 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:34.921725 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:46:34.923628 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:34.923650 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:34.924019 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:34.924325 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:34.926187 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:34.927545 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:34.929365 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:34.930069 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:34.930187 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:34.934931 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:34.934939 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:34.934954 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:34.934987 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:34.938119 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:34.938839 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:34.938848 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:34.938862 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:34.939017 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:34.939412 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:34.939417 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:34.939421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:34.939926 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:34.940209 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:34.940621 (+ 412us) server_negotiation.cc:299] Negotiation successful
0923 19:46:34.941002 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":380,"threads_started":1}
I20260923 19:46:34.942292 546 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:34.942458 546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:34.944686 546 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43795 } }
I20260923 19:46:34.945178 546 leader_election.cc:302] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03d559a47bc54dffa11bd4e0e3aba48a; no voters:
I20260923 19:46:34.945636 546 leader_election.cc:288] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:34.945778 551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:34.946565 551 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [term 1 LEADER]: Becoming Leader. State: Replica: 03d559a47bc54dffa11bd4e0e3aba48a, State: Running, Role: LEADER
I20260923 19:46:34.947077 551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43795 } }
I20260923 19:46:34.947817 546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:34.949504 553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03d559a47bc54dffa11bd4e0e3aba48a. Latest consensus state: current_term: 1 leader_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43795 } } }
I20260923 19:46:34.949808 553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:34.953019 556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:34.952899 552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03d559a47bc54dffa11bd4e0e3aba48a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43795 } } }
I20260923 19:46:34.953194 552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:34.957553 556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:34.965818 556 catalog_manager.cc:1347] Generated new cluster ID: cbe3e18ae45b4e24a199cc9adf591d40
I20260923 19:46:34.965932 556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:34.992686 556 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:34.994040 556 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:35.002128 556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a: Generated new TSK 0
I20260923 19:46:35.002954 556 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.13.88.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
Entry for principal kudu/127.13.88.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab.
I20260923 19:46:35.056306 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43795
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:35.373442 572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:35.373706 572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:35.373798 572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:35.380900 572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:35.380996 572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:35.381103 572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:46:35.390488 572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.193.keytab
--principal=kudu/127.13.88.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:35.391661 572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:35.392843 572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:35.405272 580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:35.405242 578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:35.405272 577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:35.405929 572 server_base.cc:1034] running on GCE node
I20260923 19:46:35.406420 572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:35.407294 572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:35.408509 572 hybrid_clock.cc:648] HybridClock initialized: now 1790192795408474 us; error 49 us; skew 500 ppm
I20260923 19:46:35.408798 572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:35 dist-test-slave-xg7f krb5kdc[466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192795, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:35.411883 572 init.cc:377] Logged in from keytab as kudu/127.13.88.193@KRBTEST.COM (short username kudu)
I20260923 19:46:35.413256 572 webserver.cc:460] Webserver started at http://127.13.88.193:38427/ using document root <none> and password file <none>
I20260923 19:46:35.413882 572 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:35.413980 572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:35.414233 572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:35.416980 572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "eebba260e96f45a3bf203f40ffee83ca"
format_stamp: "Formatted at 2026-09-23 19:46:35 on dist-test-slave-xg7f"
server_key: "9e003304f616eb826f952b6eb744ad5c"
server_key_iv: "6f7700771e1941234ee732cf15d07d17"
server_key_version: "encryptionkey@0"
I20260923 19:46:35.417655 572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "eebba260e96f45a3bf203f40ffee83ca"
format_stamp: "Formatted at 2026-09-23 19:46:35 on dist-test-slave-xg7f"
server_key: "9e003304f616eb826f952b6eb744ad5c"
server_key_iv: "6f7700771e1941234ee732cf15d07d17"
server_key_version: "encryptionkey@0"
I20260923 19:46:35.422459 572 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260923 19:46:35.425839 587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:35.427187 572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:46:35.427314 572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "eebba260e96f45a3bf203f40ffee83ca"
format_stamp: "Formatted at 2026-09-23 19:46:35 on dist-test-slave-xg7f"
server_key: "9e003304f616eb826f952b6eb744ad5c"
server_key_iv: "6f7700771e1941234ee732cf15d07d17"
server_key_version: "encryptionkey@0"
I20260923 19:46:35.427476 572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:35.445426 572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:35.449467 572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:35.449689 572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:35.450523 572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:35.451860 572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:35.451941 572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:35.452021 572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:35.452062 572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:35.484689 572 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:35415
I20260923 19:46:35.484732 699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:35415 every 8 connection(s)
I20260923 19:46:35.486070 572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:46:35.487728 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 572
I20260923 19:46:35.487911 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:46:35.488479 13667 external_mini_cluster.cc:1428] Setting key b42a192edc3cc1a845bf01449d6e8776
Sep 23 19:46:35 dist-test-slave-xg7f krb5kdc[466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192795, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.193@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:35.508347 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:35.488723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:56239 (local address 127.13.88.254:43795)
0923 19:46:35.489177 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:35.489183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:35.490337 (+ 1154us) server_negotiation.cc:407] Connection header received
0923 19:46:35.493173 (+ 2836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:35.493177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:35.493239 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:35.493320 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:35.495344 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.496046 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.498499 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.498894 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.498976 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:35.502884 (+ 3908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:35.502888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:35.502891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:35.502922 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:35.505323 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:35.506018 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:35.506024 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:35.506032 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:35.506137 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:35.506566 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:35.506571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:35.506576 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:35.506836 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:35.506988 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:35.507741 (+ 753us) server_negotiation.cc:299] Negotiation successful
0923 19:46:35.507984 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":241,"threads_started":1}
I20260923 19:46:35.509258 703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:35.489324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43795 (local address 127.13.88.193:56239)
0923 19:46:35.490164 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:35.490220 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:35.492869 (+ 2649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:35.493598 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:35.493611 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:35.494359 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:35.495158 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:35.495205 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.496200 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.496208 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:35.498356 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:35.498373 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.499128 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.499138 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:35.499463 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:35.500236 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:35.500261 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:35.502670 (+ 2409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:35.505471 (+ 2801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:35.505479 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:35.505494 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:35.505898 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:35.506267 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:35.506271 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:35.506282 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:35.506450 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:35.506962 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:35.506969 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:35.507364 (+ 395us) client_negotiation.cc:769] Sending connection context
0923 19:46:35.507642 (+ 278us) client_negotiation.cc:240] Negotiation successful
0923 19:46:35.508141 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":342,"threads_started":1}
I20260923 19:46:35.510965 700 heartbeater.cc:347] Connected to a master server at 127.13.88.254:43795
I20260923 19:46:35.511283 700 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:35.511987 700 heartbeater.cc:511] Master 127.13.88.254:43795 requested a full tablet report, sending...
I20260923 19:46:35.514303 511 ts_manager.cc:194] Registered new tserver with Master: eebba260e96f45a3bf203f40ffee83ca (127.13.88.193:35415)
WARNING: no policy specified for kudu/127.13.88.194@KRBTEST.COM; defaulting to no policy
I20260923 19:46:35.515995 511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.193@KRBTEST.COM'} at 127.13.88.193:56239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
Entry for principal kudu/127.13.88.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab.
I20260923 19:46:35.544342 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43795
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:35.859855 706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:35.860129 706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:35.860280 706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:35.867314 706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:35.867476 706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:35.867686 706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:46:35.877303 706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.194.keytab
--principal=kudu/127.13.88.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:35.878620 706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:35.879953 706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:35.892999 711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:35.892928 712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:35.892962 714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:35.893653 706 server_base.cc:1034] running on GCE node
I20260923 19:46:35.894227 706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:35.895081 706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:35.896346 706 hybrid_clock.cc:648] HybridClock initialized: now 1790192795896289 us; error 47 us; skew 500 ppm
I20260923 19:46:35.896649 706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:35 dist-test-slave-xg7f krb5kdc[466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192795, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:35.899729 706 init.cc:377] Logged in from keytab as kudu/127.13.88.194@KRBTEST.COM (short username kudu)
I20260923 19:46:35.901209 706 webserver.cc:460] Webserver started at http://127.13.88.194:41257/ using document root <none> and password file <none>
I20260923 19:46:35.901824 706 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:35.901919 706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:35.902180 706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:35.905061 706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42"
format_stamp: "Formatted at 2026-09-23 19:46:35 on dist-test-slave-xg7f"
server_key: "aeb89fdba13946c2b28178ab7e56b5e4"
server_key_iv: "057581affbc280db74ba452316395767"
server_key_version: "encryptionkey@0"
I20260923 19:46:35.905776 706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42"
format_stamp: "Formatted at 2026-09-23 19:46:35 on dist-test-slave-xg7f"
server_key: "aeb89fdba13946c2b28178ab7e56b5e4"
server_key_iv: "057581affbc280db74ba452316395767"
server_key_version: "encryptionkey@0"
I20260923 19:46:35.910931 706 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:46:35.914352 721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:35.915777 706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:35.915940 706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42"
format_stamp: "Formatted at 2026-09-23 19:46:35 on dist-test-slave-xg7f"
server_key: "aeb89fdba13946c2b28178ab7e56b5e4"
server_key_iv: "057581affbc280db74ba452316395767"
server_key_version: "encryptionkey@0"
I20260923 19:46:35.916123 706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:35.928916 706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:35.932705 706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:35.932989 706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:35.933864 706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:35.935065 706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:35.935218 706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:35.935374 706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:35.935448 706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:35.967680 706 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:42451
I20260923 19:46:35.967726 833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:42451 every 8 connection(s)
I20260923 19:46:35.968945 706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:46:35.976974 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 706
I20260923 19:46:35.977154 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:46:35.977614 13667 external_mini_cluster.cc:1428] Setting key 8492b5f18b136ce898ab5281547c9fce
Sep 23 19:46:35 dist-test-slave-xg7f krb5kdc[466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192795, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.194@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:35.989703 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:35.971386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:52797 (local address 127.13.88.254:43795)
0923 19:46:35.971597 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:35.971603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:35.972783 (+ 1180us) server_negotiation.cc:407] Connection header received
0923 19:46:35.974740 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:35.974744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:35.974806 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:35.974895 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:35.976374 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.977215 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.979063 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.979614 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.979736 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:35.982869 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:35.982877 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:35.982885 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:35.982928 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:35.986433 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:35.987247 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:35.987255 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:35.987261 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:35.987430 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:35.987842 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:35.987849 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:35.987855 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:35.988206 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:35.988324 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:35.989218 (+ 894us) server_negotiation.cc:299] Negotiation successful
0923 19:46:35.989382 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:46:35.991156 836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:35.971849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43795 (local address 127.13.88.194:52797)
0923 19:46:35.972609 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:35.972663 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:35.974472 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:35.975088 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:35.975096 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:35.975656 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:35.976209 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:35.976224 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.977369 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.977373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:35.978934 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:35.978948 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:35.979807 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:35.979813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:35.980004 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:35.980641 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:35.980662 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:35.982663 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:35.986586 (+ 3923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:35.986593 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:35.986605 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:35.987086 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:35.987549 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:35.987552 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:35.987554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:35.987721 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:35.988343 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:35.988353 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:35.988796 (+ 443us) client_negotiation.cc:769] Sending connection context
0923 19:46:35.989142 (+ 346us) client_negotiation.cc:240] Negotiation successful
0923 19:46:35.989691 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":269,"threads_started":1}
I20260923 19:46:35.992564 834 heartbeater.cc:347] Connected to a master server at 127.13.88.254:43795
I20260923 19:46:35.992877 834 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:35.993572 834 heartbeater.cc:511] Master 127.13.88.254:43795 requested a full tablet report, sending...
I20260923 19:46:35.994931 511 ts_manager.cc:194] Registered new tserver with Master: 8f8b2d9a357446e9a91bc6f48d9fbf42 (127.13.88.194:42451)
I20260923 19:46:35.995838 511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.194@KRBTEST.COM'} at 127.13.88.194:52797
WARNING: no policy specified for kudu/127.13.88.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
Entry for principal kudu/127.13.88.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab.
I20260923 19:46:36.030328 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43795
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:45387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:36.344069 839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:36.344386 839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:36.344556 839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:36.351841 839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:36.351986 839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:36.352154 839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:46:36.361832 839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:45387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.195.keytab
--principal=kudu/127.13.88.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:43795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:36.363093 839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:36.364387 839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:36.377811 845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:36.378526 844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:36.379513 847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:36.380118 839 server_base.cc:1034] running on GCE node
I20260923 19:46:36.380928 839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:36.382144 839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:36.383455 839 hybrid_clock.cc:648] HybridClock initialized: now 1790192796383377 us; error 70 us; skew 500 ppm
I20260923 19:46:36.383783 839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:36 dist-test-slave-xg7f krb5kdc[466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192796, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:36.386718 839 init.cc:377] Logged in from keytab as kudu/127.13.88.195@KRBTEST.COM (short username kudu)
I20260923 19:46:36.388185 839 webserver.cc:460] Webserver started at http://127.13.88.195:34875/ using document root <none> and password file <none>
I20260923 19:46:36.388861 839 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:36.389011 839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:36.389323 839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:36.392217 839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "ff9c6299ffc34a59891910e6b94143ac"
format_stamp: "Formatted at 2026-09-23 19:46:36 on dist-test-slave-xg7f"
server_key: "fbaa80bc522c8e616516688cff1f98c7"
server_key_iv: "12f8bbcb1b99559d5e716b65b113934c"
server_key_version: "encryptionkey@0"
I20260923 19:46:36.392966 839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "ff9c6299ffc34a59891910e6b94143ac"
format_stamp: "Formatted at 2026-09-23 19:46:36 on dist-test-slave-xg7f"
server_key: "fbaa80bc522c8e616516688cff1f98c7"
server_key_iv: "12f8bbcb1b99559d5e716b65b113934c"
server_key_version: "encryptionkey@0"
I20260923 19:46:36.398048 839 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:46:36.401636 854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:36.402957 839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:46:36.403085 839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "ff9c6299ffc34a59891910e6b94143ac"
format_stamp: "Formatted at 2026-09-23 19:46:36 on dist-test-slave-xg7f"
server_key: "fbaa80bc522c8e616516688cff1f98c7"
server_key_iv: "12f8bbcb1b99559d5e716b65b113934c"
server_key_version: "encryptionkey@0"
I20260923 19:46:36.403292 839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:36.436228 839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:36.440306 839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:36.440537 839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:36.441422 839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:36.442646 839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:36.442775 839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:36.442895 839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:36.442941 839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:36.473289 839 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:46135
I20260923 19:46:36.473349 966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:46135 every 8 connection(s)
I20260923 19:46:36.474645 839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:46:36.483655 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 839
I20260923 19:46:36.483876 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:46:36.484357 13667 external_mini_cluster.cc:1428] Setting key d180aa967806a44b4f3c42a6d535b2ed
Sep 23 19:46:36 dist-test-slave-xg7f krb5kdc[466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192796, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.195@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:46:36.494534 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.477120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:51013 (local address 127.13.88.254:43795)
0923 19:46:36.477302 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.477307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.478415 (+ 1108us) server_negotiation.cc:407] Connection header received
0923 19:46:36.480199 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.480204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.480300 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.480413 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:36.481812 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.482521 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.484415 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.484967 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.485120 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.489004 (+ 3884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:36.489009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:36.489014 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:36.489055 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:36.491785 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:36.492708 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:36.492712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:36.492714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:36.492835 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:36.493186 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:36.493189 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:36.493191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:36.493444 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:36.493559 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.494143 (+ 584us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.494298 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:46:36.495527 969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.477595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43795 (local address 127.13.88.195:51013)
0923 19:46:36.478255 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:36.478290 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:36.479940 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:36.480642 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:36.480650 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:36.481131 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:36.481643 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.481658 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.482670 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.482677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.484168 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.484181 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.485416 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.485421 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.485710 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.486375 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:46:36.486401 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:36.488818 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:36.491967 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:36.491977 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:36.491991 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:36.492588 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:36.492926 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:46:36.492929 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:46:36.492931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:46:36.493091 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:46:36.493544 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:36.493549 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:36.493838 (+ 289us) client_negotiation.cc:769] Sending connection context
0923 19:46:36.494046 (+ 208us) client_negotiation.cc:240] Negotiation successful
0923 19:46:36.494396 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":272,"threads_started":1}
I20260923 19:46:36.496860 967 heartbeater.cc:347] Connected to a master server at 127.13.88.254:43795
I20260923 19:46:36.497149 967 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:36.497944 967 heartbeater.cc:511] Master 127.13.88.254:43795 requested a full tablet report, sending...
I20260923 19:46:36.499644 511 ts_manager.cc:194] Registered new tserver with Master: ff9c6299ffc34a59891910e6b94143ac (127.13.88.195:46135)
I20260923 19:46:36.500392 511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.13.88.195@KRBTEST.COM'} at 127.13.88.195:51013
I20260923 19:46:36.511452 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:46:36.519645 700 heartbeater.cc:503] Master 127.13.88.254:43795 was elected leader, sending a full tablet report...
I20260923 19:46:36.527253 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.515610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33204 (local address 127.13.88.254:43795)
0923 19:46:36.515772 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.515776 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.516185 (+ 409us) server_negotiation.cc:407] Connection header received
0923 19:46:36.516314 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.516318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.516375 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.516451 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:36.517790 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.518502 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.519882 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.520600 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.520714 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.522874 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:36.522879 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:36.522882 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:36.522910 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:36.525153 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:36.525680 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:36.525683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:36.525685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:36.525798 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:36.526086 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:36.526089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:36.526090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:36.526382 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:36.526551 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.526832 (+ 281us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.526978 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:46:36.530893 511 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:46:36.537578 511 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:46:36.571935 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.548759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49608 (local address 127.13.88.194:42451)
0923 19:46:36.559046 (+ 10287us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.559055 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.559700 (+ 645us) server_negotiation.cc:407] Connection header received
0923 19:46:36.561014 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.561036 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.561309 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.561502 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:36.562633 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.564630 (+ 1997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.568062 (+ 3432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.570014 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.570162 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.570404 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.571231 (+ 827us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.571476 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10128,"thread_start_us":10035,"threads_started":1}
I20260923 19:46:36.572822 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.549179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36518 (local address 127.13.88.195:46135)
0923 19:46:36.558411 (+ 9232us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.558424 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.559701 (+ 1277us) server_negotiation.cc:407] Connection header received
0923 19:46:36.560080 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.560088 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.560399 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.560639 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:36.561434 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.563582 (+ 2148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.567306 (+ 3724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.569274 (+ 1968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.569433 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.569741 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.571912 (+ 2171us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.572304 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8991,"thread_start_us":9224,"threads_started":1}
I20260923 19:46:36.574349 979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.548545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:42451 (local address 127.0.0.1:49608)
0923 19:46:36.559536 (+ 10991us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:36.559581 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:36.559859 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:36.561786 (+ 1927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:36.561794 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:36.561840 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:36.562379 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.562394 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.564867 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.564875 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.567842 (+ 2967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.567863 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.570643 (+ 2780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.570652 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.570948 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.571001 (+ 53us) client_negotiation.cc:769] Sending connection context
0923 19:46:36.572336 (+ 1335us) client_negotiation.cc:240] Negotiation successful
0923 19:46:36.572538 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10696,"mutex_wait_us":2,"spinlock_wait_cycles":4608,"thread_start_us":10571,"threads_started":1}
I20260923 19:46:36.574661 981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.548813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:46135 (local address 127.0.0.1:36518)
0923 19:46:36.559536 (+ 10723us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:36.559581 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:36.559861 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:36.560651 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:36.560661 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:36.560709 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:36.561185 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.561199 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.563786 (+ 2587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.563795 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.567046 (+ 3251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.567067 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.569926 (+ 2859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.569935 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.570230 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.570300 (+ 70us) client_negotiation.cc:769] Sending connection context
0923 19:46:36.570457 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 19:46:36.570736 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10604,"mutex_wait_us":30,"spinlock_wait_cycles":9728,"thread_start_us":10482,"threads_started":1}
I20260923 19:46:36.578512 902 tablet_service.cc:1467] Processing CreateTablet for tablet 987ed50525d14c70a45b8d4b173eb0d6 (DEFAULT_TABLE table=test-table [id=32a41e153ccf442da02dde56054f6be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:36.578512 769 tablet_service.cc:1467] Processing CreateTablet for tablet 987ed50525d14c70a45b8d4b173eb0d6 (DEFAULT_TABLE table=test-table [id=32a41e153ccf442da02dde56054f6be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:36.580008 902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 987ed50525d14c70a45b8d4b173eb0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:36.580009 769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 987ed50525d14c70a45b8d4b173eb0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:36.581255 983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.560151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:35415 (local address 127.0.0.1:53944)
0923 19:46:36.574427 (+ 14276us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:36.574445 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:36.575315 (+ 870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:36.576170 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:36.576173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:36.576193 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:36.576405 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.576412 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.577842 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.577846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.579214 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.579229 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.580502 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.580508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.580666 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.580717 (+ 51us) client_negotiation.cc:769] Sending connection context
0923 19:46:36.580818 (+ 101us) client_negotiation.cc:240] Negotiation successful
0923 19:46:36.580938 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14123,"thread_start_us":13944,"threads_started":1}
I20260923 19:46:36.581327 984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.560336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53944 (local address 127.13.88.193:35415)
0923 19:46:36.573856 (+ 13520us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.573865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.575228 (+ 1363us) server_negotiation.cc:407] Connection header received
0923 19:46:36.575510 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.575518 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.575757 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.575960 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:36.576551 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.577679 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.579357 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.580312 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.580458 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.580696 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.580868 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.581027 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13334,"thread_start_us":13197,"threads_started":1}
I20260923 19:46:36.584638 635 tablet_service.cc:1467] Processing CreateTablet for tablet 987ed50525d14c70a45b8d4b173eb0d6 (DEFAULT_TABLE table=test-table [id=32a41e153ccf442da02dde56054f6be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:36.585841 635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 987ed50525d14c70a45b8d4b173eb0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:36.594609 985 tablet_bootstrap.cc:492] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Bootstrap starting.
I20260923 19:46:36.595623 986 tablet_bootstrap.cc:492] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Bootstrap starting.
I20260923 19:46:36.598804 986 tablet_bootstrap.cc:654] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:36.599000 985 tablet_bootstrap.cc:654] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:36.600021 986 log.cc:824] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:36.600517 985 log.cc:824] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:36.602806 986 tablet_bootstrap.cc:492] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: No bootstrap required, opened a new log
I20260923 19:46:36.603161 986 ts_tablet_manager.cc:1397] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260923 19:46:36.603485 987 tablet_bootstrap.cc:492] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Bootstrap starting.
I20260923 19:46:36.608147 987 tablet_bootstrap.cc:654] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:36.609218 987 log.cc:824] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:36.609776 985 tablet_bootstrap.cc:492] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: No bootstrap required, opened a new log
I20260923 19:46:36.610112 985 ts_tablet_manager.cc:1397] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260923 19:46:36.612073 987 tablet_bootstrap.cc:492] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: No bootstrap required, opened a new log
I20260923 19:46:36.612370 987 ts_tablet_manager.cc:1397] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.006s
I20260923 19:46:36.612102 986 raft_consensus.cc:348] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.612596 986 raft_consensus.cc:374] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:36.612694 986 raft_consensus.cc:729] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff9c6299ffc34a59891910e6b94143ac, State: Initialized, Role: FOLLOWER
I20260923 19:46:36.613296 986 consensus_queue.cc:260] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.615792 967 heartbeater.cc:503] Master 127.13.88.254:43795 was elected leader, sending a full tablet report...
I20260923 19:46:36.616420 986 ts_tablet_manager.cc:1428] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
I20260923 19:46:36.620744 985 raft_consensus.cc:348] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.621150 985 raft_consensus.cc:374] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:36.621301 985 raft_consensus.cc:729] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f8b2d9a357446e9a91bc6f48d9fbf42, State: Initialized, Role: FOLLOWER
I20260923 19:46:36.621376 987 raft_consensus.cc:348] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.621836 987 raft_consensus.cc:374] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:36.621953 987 raft_consensus.cc:729] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eebba260e96f45a3bf203f40ffee83ca, State: Initialized, Role: FOLLOWER
I20260923 19:46:36.621953 985 consensus_queue.cc:260] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.622560 987 consensus_queue.cc:260] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.623224 834 heartbeater.cc:503] Master 127.13.88.254:43795 was elected leader, sending a full tablet report...
I20260923 19:46:36.623905 985 ts_tablet_manager.cc:1428] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260923 19:46:36.624274 987 ts_tablet_manager.cc:1428] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Time spent starting tablet: real 0.012s user 0.010s sys 0.002s
W20260923 19:46:36.720919 835 tablet.cc:2369] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:46:36.726361 968 tablet.cc:2369] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:46:36.740192 701 tablet.cc:2369] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:46:36.793553 991 raft_consensus.cc:482] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:36.793936 991 raft_consensus.cc:504] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.795724 991 leader_election.cc:288] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f8b2d9a357446e9a91bc6f48d9fbf42 (127.13.88.194:42451), eebba260e96f45a3bf203f40ffee83ca (127.13.88.193:35415)
I20260923 19:46:36.801988 969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.795974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:42451 (local address 127.13.88.195:40867)
0923 19:46:36.796348 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:36.796367 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:36.796492 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:36.796842 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:36.796846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:36.796872 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:36.797075 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.797086 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.798340 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.798346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.800039 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.800059 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.801278 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.801285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.801476 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.801512 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 19:46:36.801610 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 19:46:36.801751 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":1}
I20260923 19:46:36.802386 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.796179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:40867 (local address 127.13.88.194:42451)
0923 19:46:36.796408 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.796416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.796440 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:46:36.796674 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.796677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.796735 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.796831 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:36.797209 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.798203 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.800198 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.801138 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.801244 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.801299 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.801655 (+ 356us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.802156 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260923 19:46:36.802493 984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.796293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:52357 (local address 127.13.88.193:35415)
0923 19:46:36.796475 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.796481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.797014 (+ 533us) server_negotiation.cc:407] Connection header received
0923 19:46:36.797123 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.797130 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.797216 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.797275 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:36.797895 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.798785 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.800680 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.801586 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.801722 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.801782 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.802146 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.802278 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:46:36.802932 994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.796221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:35415 (local address 127.13.88.195:52357)
0923 19:46:36.796917 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:36.796929 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:36.797028 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:36.797331 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:36.797335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:36.797357 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:36.797748 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.797759 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.798978 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.798981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.800536 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:36.800550 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.801778 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.801785 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:36.801968 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.802002 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:46:36.802633 (+ 631us) client_negotiation.cc:240] Negotiation successful
0923 19:46:36.802719 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":399,"threads_started":1}
I20260923 19:46:36.803369 789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987ed50525d14c70a45b8d4b173eb0d6" candidate_uuid: "ff9c6299ffc34a59891910e6b94143ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" is_pre_election: true
I20260923 19:46:36.803946 789 raft_consensus.cc:2454] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff9c6299ffc34a59891910e6b94143ac in term 0.
I20260923 19:46:36.803964 655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987ed50525d14c70a45b8d4b173eb0d6" candidate_uuid: "ff9c6299ffc34a59891910e6b94143ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eebba260e96f45a3bf203f40ffee83ca" is_pre_election: true
I20260923 19:46:36.804463 655 raft_consensus.cc:2454] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff9c6299ffc34a59891910e6b94143ac in term 0.
I20260923 19:46:36.804623 856 leader_election.cc:302] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f8b2d9a357446e9a91bc6f48d9fbf42, ff9c6299ffc34a59891910e6b94143ac; no voters:
I20260923 19:46:36.805007 991 raft_consensus.cc:2781] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:46:36.805160 991 raft_consensus.cc:482] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:46:36.805267 991 raft_consensus.cc:3037] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:36.807518 991 raft_consensus.cc:504] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.808073 991 leader_election.cc:288] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [CANDIDATE]: Term 1 election: Requested vote from peers 8f8b2d9a357446e9a91bc6f48d9fbf42 (127.13.88.194:42451), eebba260e96f45a3bf203f40ffee83ca (127.13.88.193:35415)
I20260923 19:46:36.808497 789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987ed50525d14c70a45b8d4b173eb0d6" candidate_uuid: "ff9c6299ffc34a59891910e6b94143ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42"
I20260923 19:46:36.808537 655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "987ed50525d14c70a45b8d4b173eb0d6" candidate_uuid: "ff9c6299ffc34a59891910e6b94143ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eebba260e96f45a3bf203f40ffee83ca"
I20260923 19:46:36.808681 789 raft_consensus.cc:3037] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:36.808753 655 raft_consensus.cc:3037] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:36.810842 789 raft_consensus.cc:2454] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff9c6299ffc34a59891910e6b94143ac in term 1.
I20260923 19:46:36.810961 655 raft_consensus.cc:2454] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff9c6299ffc34a59891910e6b94143ac in term 1.
I20260923 19:46:36.811242 856 leader_election.cc:302] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f8b2d9a357446e9a91bc6f48d9fbf42, ff9c6299ffc34a59891910e6b94143ac; no voters:
I20260923 19:46:36.811540 991 raft_consensus.cc:2781] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:36.811961 991 raft_consensus.cc:686] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 1 LEADER]: Becoming Leader. State: Replica: ff9c6299ffc34a59891910e6b94143ac, State: Running, Role: LEADER
I20260923 19:46:36.812412 991 consensus_queue.cc:237] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } }
I20260923 19:46:36.817039 510 catalog_manager.cc:5495] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac reported cstate change: term changed from 0 to 1, leader changed from <none> to ff9c6299ffc34a59891910e6b94143ac (127.13.88.195). New cstate: current_term: 1 leader_uuid: "ff9c6299ffc34a59891910e6b94143ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff9c6299ffc34a59891910e6b94143ac" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 46135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 } health_report { overall_health: UNKNOWN } } }
I20260923 19:46:36.884960 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.879907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36534 (local address 127.13.88.195:46135)
0923 19:46:36.880166 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.880171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.880189 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:46:36.880359 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.880362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.880454 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.880573 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:46:36.880888 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.881598 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.882890 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.883345 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.883432 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.883881 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:46:36.884388 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:46:36.884503 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.884579 (+ 76us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.884646 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:46:36.893040 789 raft_consensus.cc:1261] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 1 FOLLOWER]: Refusing update from remote peer ff9c6299ffc34a59891910e6b94143ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:36.893040 655 raft_consensus.cc:1261] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 1 FOLLOWER]: Refusing update from remote peer ff9c6299ffc34a59891910e6b94143ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:36.893970 995 consensus_queue.cc:1035] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "eebba260e96f45a3bf203f40ffee83ca" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:36.894286 991 consensus_queue.cc:1035] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f8b2d9a357446e9a91bc6f48d9fbf42" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:36.906162 998 mvcc.cc:205] Tried to move back new op lower bound from 7332629696064385024 to 7332629695747633152. Current Snapshot: MvccSnapshot[applied={T|T < 7332629696064385024}]
I20260923 19:46:36.919575 510 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:36.919865 510 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:36.923766 510 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03d559a47bc54dffa11bd4e0e3aba48a: Sending DeleteTablet for 3 replicas of tablet 987ed50525d14c70a45b8d4b173eb0d6
I20260923 19:46:36.924847 902 tablet_service.cc:1514] Processing DeleteTablet for tablet 987ed50525d14c70a45b8d4b173eb0d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:36 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:36518
I20260923 19:46:36.924863 769 tablet_service.cc:1514] Processing DeleteTablet for tablet 987ed50525d14c70a45b8d4b173eb0d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:36 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:49608
I20260923 19:46:36.926934 635 tablet_service.cc:1514] Processing DeleteTablet for tablet 987ed50525d14c70a45b8d4b173eb0d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:36 UTC) from {username='kudu', principal='kudu/127.13.88.254@KRBTEST.COM'} at 127.0.0.1:53944
I20260923 19:46:36.934973 1009 tablet_replica.cc:330] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: stopping tablet replica
I20260923 19:46:36.935386 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 572
I20260923 19:46:36.935369 1009 raft_consensus.cc:2229] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:36.935806 1009 raft_consensus.cc:2258] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:36.937173 1007 tablet_replica.cc:330] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: stopping tablet replica
I20260923 19:46:36.937569 1007 raft_consensus.cc:2229] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:46:36.938215 1007 raft_consensus.cc:2258] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:36.938535 1009 ts_tablet_manager.cc:1905] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:36.939018 1008 tablet_replica.cc:330] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: stopping tablet replica
I20260923 19:46:36.939419 1008 raft_consensus.cc:2229] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:36.939877 1008 raft_consensus.cc:2258] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:36.941691 1007 ts_tablet_manager.cc:1905] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:36.945631 1009 ts_tablet_manager.cc:1918] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:36.947465 1008 ts_tablet_manager.cc:1905] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:36.948987 1007 ts_tablet_manager.cc:1918] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:36.949180 1007 log.cc:1196] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/987ed50525d14c70a45b8d4b173eb0d6
I20260923 19:46:36.949725 1007 ts_tablet_manager.cc:1939] T 987ed50525d14c70a45b8d4b173eb0d6 P ff9c6299ffc34a59891910e6b94143ac: Deleting consensus metadata
I20260923 19:46:36.951439 1009 log.cc:1196] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/987ed50525d14c70a45b8d4b173eb0d6
I20260923 19:46:36.951565 495 catalog_manager.cc:4841] TS ff9c6299ffc34a59891910e6b94143ac (127.13.88.195:46135): tablet 987ed50525d14c70a45b8d4b173eb0d6 (table test-table [id=32a41e153ccf442da02dde56054f6be0]) successfully deleted
I20260923 19:46:36.952028 1009 ts_tablet_manager.cc:1939] T 987ed50525d14c70a45b8d4b173eb0d6 P eebba260e96f45a3bf203f40ffee83ca: Deleting consensus metadata
I20260923 19:46:36.953780 495 catalog_manager.cc:4841] TS eebba260e96f45a3bf203f40ffee83ca (127.13.88.193:35415): tablet 987ed50525d14c70a45b8d4b173eb0d6 (table test-table [id=32a41e153ccf442da02dde56054f6be0]) successfully deleted
I20260923 19:46:36.954703 1008 ts_tablet_manager.cc:1918] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:36.954883 1008 log.cc:1196] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/987ed50525d14c70a45b8d4b173eb0d6
I20260923 19:46:36.955502 1008 ts_tablet_manager.cc:1939] T 987ed50525d14c70a45b8d4b173eb0d6 P 8f8b2d9a357446e9a91bc6f48d9fbf42: Deleting consensus metadata
I20260923 19:46:36.957194 496 catalog_manager.cc:4841] TS 8f8b2d9a357446e9a91bc6f48d9fbf42 (127.13.88.194:42451): tablet 987ed50525d14c70a45b8d4b173eb0d6 (table test-table [id=32a41e153ccf442da02dde56054f6be0]) successfully deleted
Sep 23 19:46:36 dist-test-slave-xg7f krb5kdc[466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.193@KRBTEST.COM
I20260923 19:46:36.965183 984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:36.936967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53960 (local address 127.13.88.193:35415)
0923 19:46:36.937140 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:36.937148 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:36.946698 (+ 9550us) server_negotiation.cc:407] Connection header received
0923 19:46:36.947206 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:36.947212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:36.947295 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:36.947387 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:36.949375 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.950500 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.953270 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:36.953943 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:36.954040 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:36.958975 (+ 4935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:36.958989 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:36.959008 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:36.959048 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:36.962590 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:36.963281 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:36.963290 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:36.963293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:36.963459 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:36.963785 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:36.963789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:36.963793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:36.964195 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:36.964470 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:36.964618 (+ 148us) server_negotiation.cc:299] Negotiation successful
0923 19:46:36.964813 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 19:46:36.965900 695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:37.068536 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 572
I20260923 19:46:37.087579 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 706
Sep 23 19:46:37 dist-test-slave-xg7f krb5kdc[466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.194@KRBTEST.COM
I20260923 19:46:37.102490 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:37.088450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49616 (local address 127.13.88.194:42451)
0923 19:46:37.088647 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:37.088653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:37.088675 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:46:37.088802 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:37.088824 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:37.088923 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:37.089061 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:37.090276 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:37.091072 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:37.092324 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:37.092707 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:37.092837 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:37.096924 (+ 4087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:37.096939 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:37.096954 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:37.096988 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:37.099888 (+ 2900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:37.100532 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:37.100540 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:37.100542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:37.100658 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:37.101071 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:37.101077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:37.101080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:37.101430 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:37.101696 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:37.101971 (+ 275us) server_negotiation.cc:299] Negotiation successful
0923 19:46:37.102171 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:46:37.103328 829 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:37.193979 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 706
I20260923 19:46:37.211535 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 839
Sep 23 19:46:37 dist-test-slave-xg7f krb5kdc[466](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.195@KRBTEST.COM
I20260923 19:46:37.227632 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:37.212570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36546 (local address 127.13.88.195:46135)
0923 19:46:37.212782 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:37.212787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:37.212802 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:46:37.212853 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:37.212856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:37.212914 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:37.213042 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:37.214346 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:37.215294 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:37.216558 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:37.217021 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:37.217156 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:37.221537 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:37.221550 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:37.221566 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:37.221613 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:37.224658 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:37.225409 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:37.225419 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:37.225428 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:37.225608 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:37.225990 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:37.225996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:37.226001 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:37.226361 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:37.226677 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:37.226990 (+ 313us) server_negotiation.cc:299] Negotiation successful
0923 19:46:37.227245 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260923 19:46:37.228418 962 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:37.349165 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 839
I20260923 19:46:37.368182 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 479
I20260923 19:46:37.369338 541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:37.478921 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 479
2026-09-23T19:46:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4316 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-23T19:46:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:37Z Disabled control of system clock
I20260923 19:46:37.551789 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:41837
--webserver_interface=127.13.88.254
--webserver_port=0
--builtin_ntp_servers=127.13.88.212:43511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:41837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:46:37.885936 1018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:37.886237 1018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:37.886328 1018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:37.893759 1018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:37.893873 1018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:37.893910 1018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:37.893967 1018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:37.894011 1018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:37.902897 1018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:41837
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:41837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:37.904213 1018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:37.906001 1018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:37.917603 1023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:37.917709 1024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:37.917733 1026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:37.918589 1018 server_base.cc:1034] running on GCE node
I20260923 19:46:37.919456 1018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:37.920934 1018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:37.922155 1018 hybrid_clock.cc:648] HybridClock initialized: now 1790192797922095 us; error 61 us; skew 500 ppm
I20260923 19:46:37.922509 1018 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:37.924844 1018 webserver.cc:460] Webserver started at http://127.13.88.254:36063/ using document root <none> and password file <none>
I20260923 19:46:37.925616 1018 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:37.925740 1018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:37.926047 1018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:37.928984 1018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "dae2b299a5cb4a3fb6f4d6b82314496a"
format_stamp: "Formatted at 2026-09-23 19:46:37 on dist-test-slave-xg7f"
server_key: "ab4f094627850bfcae8763646ed59ea7"
server_key_iv: "f469b80c113680a4b25eca87c6d8f958"
server_key_version: "encryptionkey@0"
I20260923 19:46:37.929771 1018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "dae2b299a5cb4a3fb6f4d6b82314496a"
format_stamp: "Formatted at 2026-09-23 19:46:37 on dist-test-slave-xg7f"
server_key: "ab4f094627850bfcae8763646ed59ea7"
server_key_iv: "f469b80c113680a4b25eca87c6d8f958"
server_key_version: "encryptionkey@0"
I20260923 19:46:37.934717 1018 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260923 19:46:37.938172 1032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:37.939541 1018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:46:37.939718 1018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "dae2b299a5cb4a3fb6f4d6b82314496a"
format_stamp: "Formatted at 2026-09-23 19:46:37 on dist-test-slave-xg7f"
server_key: "ab4f094627850bfcae8763646ed59ea7"
server_key_iv: "f469b80c113680a4b25eca87c6d8f958"
server_key_version: "encryptionkey@0"
I20260923 19:46:37.939929 1018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:37.957096 1018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:37.957954 1018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:37.958241 1018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:37.976765 1018 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:41837
I20260923 19:46:37.976791 1083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:41837 every 8 connection(s)
I20260923 19:46:37.978130 1018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:37.981729 1084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:37.986567 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1018
I20260923 19:46:37.986697 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:37.987221 13667 external_mini_cluster.cc:1428] Setting key 8165236c0daf21d684ad494e44ffb48d
I20260923 19:46:37.993798 1084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a: Bootstrap starting.
I20260923 19:46:37.997524 1084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:37.998847 1084 log.cc:824] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:38.002328 1084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a: No bootstrap required, opened a new log
I20260923 19:46:38.002964 1087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:37.989136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34824 (local address 127.13.88.254:41837)
0923 19:46:37.990292 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:37.990307 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:37.990354 (+ 47us) server_negotiation.cc:407] Connection header received
0923 19:46:37.992844 (+ 2490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:37.992873 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:37.993427 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:37.993881 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:37.994389 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:37.996419 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:37.997716 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:37.998827 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:37.999027 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:38.000208 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:38.000215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:38.000228 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:38.000931 (+ 703us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:38.001029 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:38.001054 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:38.001165 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:38.001369 (+ 204us) server_negotiation.cc:299] Negotiation successful
0923 19:46:38.001693 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":344,"threads_started":1}
I20260923 19:46:38.010619 1084 raft_consensus.cc:348] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41837 } }
I20260923 19:46:38.011027 1084 raft_consensus.cc:374] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:38.011147 1084 raft_consensus.cc:729] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dae2b299a5cb4a3fb6f4d6b82314496a, State: Initialized, Role: FOLLOWER
I20260923 19:46:38.011795 1084 consensus_queue.cc:260] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41837 } }
I20260923 19:46:38.012091 1084 raft_consensus.cc:388] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:38.012282 1084 raft_consensus.cc:482] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:38.012483 1084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:38.014715 1084 raft_consensus.cc:504] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41837 } }
I20260923 19:46:38.015338 1084 leader_election.cc:302] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dae2b299a5cb4a3fb6f4d6b82314496a; no voters:
I20260923 19:46:38.015913 1084 leader_election.cc:288] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:38.016073 1089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:38.016909 1089 raft_consensus.cc:686] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [term 1 LEADER]: Becoming Leader. State: Replica: dae2b299a5cb4a3fb6f4d6b82314496a, State: Running, Role: LEADER
I20260923 19:46:38.017450 1089 consensus_queue.cc:237] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41837 } }
I20260923 19:46:38.018170 1084 sys_catalog.cc:564] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:38.020548 1090 sys_catalog.cc:455] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41837 } } }
I20260923 19:46:38.020946 1090 sys_catalog.cc:458] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:38.021462 1091 sys_catalog.cc:455] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dae2b299a5cb4a3fb6f4d6b82314496a. Latest consensus state: current_term: 1 leader_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae2b299a5cb4a3fb6f4d6b82314496a" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 41837 } } }
I20260923 19:46:38.021796 1091 sys_catalog.cc:458] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:38.021981 1095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:38.029265 1095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:38.037626 1095 catalog_manager.cc:1347] Generated new cluster ID: 1ec1c8debc1a4854a42a158b52236ade
I20260923 19:46:38.037842 1095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:38.072602 1095 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:38.073937 1095 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:38.083047 1095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a: Generated new TSK 0
I20260923 19:46:38.084151 1095 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:38.089402 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.193:0
--local_ip_for_outbound_sockets=127.13.88.193
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41837
--builtin_ntp_servers=127.13.88.212:43511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 19:46:38.437592 1109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:38.437939 1109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:38.438086 1109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:38.445326 1109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:38.445420 1109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:38.445612 1109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.193
I20260923 19:46:38.454440 1109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.88.193
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.193
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:38.455804 1109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:38.457594 1109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:38.471056 1117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:38.471174 1114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:38.471140 1115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:38.476598 1109 server_base.cc:1034] running on GCE node
I20260923 19:46:38.477255 1109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:38.478236 1109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:38.479465 1109 hybrid_clock.cc:648] HybridClock initialized: now 1790192798479425 us; error 32 us; skew 500 ppm
I20260923 19:46:38.479787 1109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:38.482003 1109 webserver.cc:460] Webserver started at http://127.13.88.193:38951/ using document root <none> and password file <none>
I20260923 19:46:38.482717 1109 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:38.482863 1109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:38.483248 1109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:38.486200 1109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data/instance:
uuid: "845d87cf78bb47a3bd522917c2b04d77"
format_stamp: "Formatted at 2026-09-23 19:46:38 on dist-test-slave-xg7f"
server_key: "ab1afe0fee45c760931f4a6054a9b870"
server_key_iv: "3253fc8061dcc76291b399672275a91d"
server_key_version: "encryptionkey@0"
I20260923 19:46:38.486994 1109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance:
uuid: "845d87cf78bb47a3bd522917c2b04d77"
format_stamp: "Formatted at 2026-09-23 19:46:38 on dist-test-slave-xg7f"
server_key: "ab1afe0fee45c760931f4a6054a9b870"
server_key_iv: "3253fc8061dcc76291b399672275a91d"
server_key_version: "encryptionkey@0"
I20260923 19:46:38.492226 1109 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:46:38.495595 1123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:38.496826 1109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:46:38.496999 1109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal
uuid: "845d87cf78bb47a3bd522917c2b04d77"
format_stamp: "Formatted at 2026-09-23 19:46:38 on dist-test-slave-xg7f"
server_key: "ab1afe0fee45c760931f4a6054a9b870"
server_key_iv: "3253fc8061dcc76291b399672275a91d"
server_key_version: "encryptionkey@0"
I20260923 19:46:38.497223 1109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:38.509255 1109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:38.510058 1109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:38.510349 1109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:38.511359 1109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:38.512698 1109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:38.512822 1109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:38.512962 1109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:38.513049 1109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:38.544132 1109 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.193:43699
I20260923 19:46:38.544243 1235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.193:43699 every 8 connection(s)
I20260923 19:46:38.545722 1109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/data/info.pb
I20260923 19:46:38.548192 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1109
I20260923 19:46:38.548372 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal/instance
I20260923 19:46:38.548887 13667 external_mini_cluster.cc:1428] Setting key 8130d425c46fed4ab935604a7e83925a
I20260923 19:46:38.551748 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.194:0
--local_ip_for_outbound_sockets=127.13.88.194
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41837
--builtin_ntp_servers=127.13.88.212:43511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:46:38.559613 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:38.548604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:39311 (local address 127.13.88.254:41837)
0923 19:46:38.549102 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:38.549108 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:38.550528 (+ 1420us) server_negotiation.cc:407] Connection header received
0923 19:46:38.552530 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:38.552539 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:38.552630 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:38.552752 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:38.553825 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.554982 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.556584 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.557321 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.557462 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:38.558787 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:38.558797 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:38.558805 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:38.558833 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:38.558888 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:38.558908 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:38.559003 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:38.559274 (+ 271us) server_negotiation.cc:299] Negotiation successful
0923 19:46:38.559357 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":247,"threads_started":1}
I20260923 19:46:38.560995 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:38.549273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41837 (local address 127.13.88.193:39311)
0923 19:46:38.550369 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:38.550415 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:38.552259 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:38.552960 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:38.552968 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:38.553067 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:38.553653 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:38.553670 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.555180 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.555184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:38.556431 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:38.556443 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.557524 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.557528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:38.557731 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:38.558460 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:38.558463 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:38.558510 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:38.558592 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:38.559004 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:38.559012 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:38.559017 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:46:38.559247 (+ 230us) client_negotiation.cc:240] Negotiation successful
0923 19:46:38.559699 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":348,"threads_started":1}
I20260923 19:46:38.562554 1236 heartbeater.cc:347] Connected to a master server at 127.13.88.254:41837
I20260923 19:46:38.562853 1236 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:38.563642 1236 heartbeater.cc:511] Master 127.13.88.254:41837 requested a full tablet report, sending...
I20260923 19:46:38.565888 1049 ts_manager.cc:194] Registered new tserver with Master: 845d87cf78bb47a3bd522917c2b04d77 (127.13.88.193:43699)
I20260923 19:46:38.568153 1049 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.193:39311
W20260923 19:46:38.877846 1240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:38.878124 1240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:38.878209 1240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:38.885285 1240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:38.885383 1240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:38.885486 1240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.194
I20260923 19:46:38.894655 1240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.88.194
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.194
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:38.895951 1240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:38.897697 1240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:38.911238 1248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:38.911319 1245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:38.911284 1246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:38.912019 1240 server_base.cc:1034] running on GCE node
I20260923 19:46:38.912624 1240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:38.913553 1240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:38.914798 1240 hybrid_clock.cc:648] HybridClock initialized: now 1790192798914749 us; error 55 us; skew 500 ppm
I20260923 19:46:38.915184 1240 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:38.917373 1240 webserver.cc:460] Webserver started at http://127.13.88.194:33015/ using document root <none> and password file <none>
I20260923 19:46:38.918141 1240 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:38.918272 1240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:38.918583 1240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:38.921509 1240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data/instance:
uuid: "5d31be9971b74100a96d75ebdc13a30c"
format_stamp: "Formatted at 2026-09-23 19:46:38 on dist-test-slave-xg7f"
server_key: "9c12f47a5c62b8a0ac823d3c8508ae62"
server_key_iv: "a8116d3580770cd064ea456c97868784"
server_key_version: "encryptionkey@0"
I20260923 19:46:38.922289 1240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance:
uuid: "5d31be9971b74100a96d75ebdc13a30c"
format_stamp: "Formatted at 2026-09-23 19:46:38 on dist-test-slave-xg7f"
server_key: "9c12f47a5c62b8a0ac823d3c8508ae62"
server_key_iv: "a8116d3580770cd064ea456c97868784"
server_key_version: "encryptionkey@0"
I20260923 19:46:38.927546 1240 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260923 19:46:38.931051 1254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:38.932370 1240 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:46:38.932547 1240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal
uuid: "5d31be9971b74100a96d75ebdc13a30c"
format_stamp: "Formatted at 2026-09-23 19:46:38 on dist-test-slave-xg7f"
server_key: "9c12f47a5c62b8a0ac823d3c8508ae62"
server_key_iv: "a8116d3580770cd064ea456c97868784"
server_key_version: "encryptionkey@0"
I20260923 19:46:38.932797 1240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:38.947619 1240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:38.948516 1240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:38.948828 1240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:38.949786 1240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:38.951258 1240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:38.951373 1240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:38.951506 1240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:38.951601 1240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:38.984603 1240 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.194:35355
I20260923 19:46:38.984627 1366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.194:35355 every 8 connection(s)
I20260923 19:46:38.985911 1240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/data/info.pb
I20260923 19:46:38.989494 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1240
I20260923 19:46:38.989645 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal/instance
I20260923 19:46:38.990180 13667 external_mini_cluster.cc:1428] Setting key b638de507648928a86a81716af228448
I20260923 19:46:38.993144 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.88.195:0
--local_ip_for_outbound_sockets=127.13.88.195
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41837
--builtin_ntp_servers=127.13.88.212:43511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 19:46:38.999522 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:38.988571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.194:48755 (local address 127.13.88.254:41837)
0923 19:46:38.988789 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:38.988795 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:38.990361 (+ 1566us) server_negotiation.cc:407] Connection header received
0923 19:46:38.992678 (+ 2317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:38.992684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:38.992766 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:38.992879 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:38.994034 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.994751 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.996421 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.997128 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.997269 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:38.998578 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:38.998587 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:38.998595 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:38.998622 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:38.998666 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:38.998685 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:38.998782 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:38.998981 (+ 199us) server_negotiation.cc:299] Negotiation successful
0923 19:46:38.999095 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:46:39.000476 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:38.989172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41837 (local address 127.13.88.194:48755)
0923 19:46:38.990201 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:38.990245 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:38.992421 (+ 2176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:38.993111 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:38.993123 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:38.993249 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:38.993869 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:38.993885 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.994956 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.994965 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:38.996260 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:38.996283 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:38.997334 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:38.997338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:38.997554 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:38.998268 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:38.998271 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:38.998316 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:38.998390 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:38.998783 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:38.998790 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:38.998796 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 19:46:38.998934 (+ 138us) client_negotiation.cc:240] Negotiation successful
0923 19:46:38.999340 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":323,"threads_started":1}
I20260923 19:46:39.002142 1367 heartbeater.cc:347] Connected to a master server at 127.13.88.254:41837
I20260923 19:46:39.002506 1367 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:39.003435 1367 heartbeater.cc:511] Master 127.13.88.254:41837 requested a full tablet report, sending...
I20260923 19:46:39.004966 1049 ts_manager.cc:194] Registered new tserver with Master: 5d31be9971b74100a96d75ebdc13a30c (127.13.88.194:35355)
I20260923 19:46:39.006217 1049 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.194:48755
W20260923 19:46:39.317710 1370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:39.318056 1370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:39.318156 1370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:39.325294 1370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:39.325380 1370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:39.325482 1370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.88.195
I20260923 19:46:39.334455 1370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:43511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.88.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.88.195
--webserver_port=0
--tserver_master_addrs=127.13.88.254:41837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.88.195
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:39.335743 1370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:39.337575 1370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:39.349188 1375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:39.350133 1376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:39.350910 1378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:39.351755 1370 server_base.cc:1034] running on GCE node
I20260923 19:46:39.352288 1370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:39.353168 1370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:39.354367 1370 hybrid_clock.cc:648] HybridClock initialized: now 1790192799354324 us; error 44 us; skew 500 ppm
I20260923 19:46:39.354645 1370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:46:39.356851 1370 webserver.cc:460] Webserver started at http://127.13.88.195:41205/ using document root <none> and password file <none>
I20260923 19:46:39.357486 1370 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:39.357581 1370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:39.357858 1370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:39.360702 1370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data/instance:
uuid: "1c7318da0efc4ec2be8de8fdf578f652"
format_stamp: "Formatted at 2026-09-23 19:46:39 on dist-test-slave-xg7f"
server_key: "6d94b404ebc59b80e081f4218982aa1f"
server_key_iv: "25ba7e63a33727d6c04c3d51c916243a"
server_key_version: "encryptionkey@0"
I20260923 19:46:39.361440 1370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance:
uuid: "1c7318da0efc4ec2be8de8fdf578f652"
format_stamp: "Formatted at 2026-09-23 19:46:39 on dist-test-slave-xg7f"
server_key: "6d94b404ebc59b80e081f4218982aa1f"
server_key_iv: "25ba7e63a33727d6c04c3d51c916243a"
server_key_version: "encryptionkey@0"
I20260923 19:46:39.366407 1370 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:46:39.369625 1384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:39.370944 1370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:46:39.371110 1370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal
uuid: "1c7318da0efc4ec2be8de8fdf578f652"
format_stamp: "Formatted at 2026-09-23 19:46:39 on dist-test-slave-xg7f"
server_key: "6d94b404ebc59b80e081f4218982aa1f"
server_key_iv: "25ba7e63a33727d6c04c3d51c916243a"
server_key_version: "encryptionkey@0"
I20260923 19:46:39.371374 1370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:39.395195 1370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:39.396050 1370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:39.396368 1370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:39.397331 1370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 19:46:39.398798 1370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:46:39.398885 1370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:39.399046 1370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 19:46:39.399160 1370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:39.432189 1370 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.195:37249
I20260923 19:46:39.432273 1496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.195:37249 every 8 connection(s)
I20260923 19:46:39.433499 1370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/data/info.pb
I20260923 19:46:39.441360 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1370
I20260923 19:46:39.441543 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal/instance
I20260923 19:46:39.441948 13667 external_mini_cluster.cc:1428] Setting key 47be9e2ec1efb1aacaabde0ba3a88035
I20260923 19:46:39.446009 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.435954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.195:33515 (local address 127.13.88.254:41837)
0923 19:46:39.436121 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.436125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.437530 (+ 1405us) server_negotiation.cc:407] Connection header received
0923 19:46:39.439384 (+ 1854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.439390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.439482 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.439591 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:39.440619 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.441333 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.443202 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.443868 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.443963 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.445391 (+ 1428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:39.445396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:39.445399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:39.445417 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:39.445448 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:39.445459 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:39.445528 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.445707 (+ 179us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.445783 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 19:46:39.446938 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.436476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:41837 (local address 127.13.88.195:33515)
0923 19:46:39.437386 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.437421 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:39.439049 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:39.439820 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:39.439827 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:39.439915 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:46:39.440461 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.440475 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.441470 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.441475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.443044 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.443075 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.444079 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.444087 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.444366 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.445109 (+ 743us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 19:46:39.445111 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:46:39.445149 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 19:46:39.445224 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:46:39.445541 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:46:39.445549 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:46:39.445554 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 19:46:39.445683 (+ 129us) client_negotiation.cc:240] Negotiation successful
0923 19:46:39.445965 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":288,"threads_started":1}
I20260923 19:46:39.448256 1497 heartbeater.cc:347] Connected to a master server at 127.13.88.254:41837
I20260923 19:46:39.448535 1497 heartbeater.cc:464] Registering TS with master...
I20260923 19:46:39.449235 1497 heartbeater.cc:511] Master 127.13.88.254:41837 requested a full tablet report, sending...
I20260923 19:46:39.450460 1049 ts_manager.cc:194] Registered new tserver with Master: 1c7318da0efc4ec2be8de8fdf578f652 (127.13.88.195:37249)
I20260923 19:46:39.451290 1049 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.13.88.195:33515
I20260923 19:46:39.456768 13667 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 19:46:39.465802 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.460701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34838 (local address 127.13.88.254:41837)
0923 19:46:39.460887 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.460892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.461263 (+ 371us) server_negotiation.cc:407] Connection header received
0923 19:46:39.461401 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.461404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.461470 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.461544 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:39.461965 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.462603 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.463956 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.464327 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.464409 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.465278 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:39.465282 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:39.465285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:39.465301 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:39.465330 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:39.465341 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:39.465405 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.465515 (+ 110us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.465584 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 19:46:39.469673 1049 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:46:39.476495 1049 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:46:39.502156 1509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.488141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37249 (local address 127.0.0.1:56430)
0923 19:46:39.489695 (+ 1554us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.489740 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:39.489916 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:39.491258 (+ 1342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:39.491269 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:39.491322 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:39.491836 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.491853 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.494564 (+ 2711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.494572 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.497728 (+ 3156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.497754 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.500800 (+ 3046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.500806 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.501173 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.501246 (+ 73us) client_negotiation.cc:769] Sending connection context
0923 19:46:39.501415 (+ 169us) client_negotiation.cc:240] Negotiation successful
0923 19:46:39.501681 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1278,"thread_start_us":1107,"threads_started":1}
I20260923 19:46:39.503269 1510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.488475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56430 (local address 127.13.88.195:37249)
0923 19:46:39.489325 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.489334 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.490129 (+ 795us) server_negotiation.cc:407] Connection header received
0923 19:46:39.490264 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.490275 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.490591 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.490830 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:39.492122 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.494352 (+ 2230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.498036 (+ 3684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.500096 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.500256 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.500640 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.502761 (+ 2121us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.502925 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":440,"threads_started":1}
I20260923 19:46:39.507959 1432 tablet_service.cc:1467] Processing CreateTablet for tablet 41552ebf4ea54f0680a114e90e2fa6e2 (DEFAULT_TABLE table=test-table [id=e36ed52f849f4fa088f54b3690a15bbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:39.509629 1432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41552ebf4ea54f0680a114e90e2fa6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:39.511970 1509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.490014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:35355 (local address 127.0.0.1:39754)
0923 19:46:39.503502 (+ 13488us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.503519 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:39.503613 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:39.504951 (+ 1338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:39.504957 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:39.504983 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:39.505207 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.505221 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.507620 (+ 2399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.507623 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.508975 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.508986 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.511082 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.511088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.511285 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.511327 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 19:46:39.511447 (+ 120us) client_negotiation.cc:240] Negotiation successful
0923 19:46:39.511590 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13397,"mutex_wait_us":5,"thread_start_us":13828,"threads_started":1}
I20260923 19:46:39.511976 1514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.490498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39754 (local address 127.13.88.194:35355)
0923 19:46:39.504378 (+ 13880us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.504386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.504410 (+ 24us) server_negotiation.cc:407] Connection header received
0923 19:46:39.504500 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.504506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.504735 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.504945 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:39.505571 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.507453 (+ 1882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.509124 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.510917 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.511057 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.511325 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.511487 (+ 162us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.511648 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13705,"thread_start_us":13595,"threads_started":1}
I20260923 19:46:39.512859 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.488968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44640)
0923 19:46:39.503043 (+ 14075us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.503067 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:39.503337 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:39.504422 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:39.504425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:39.504445 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:39.504660 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.504667 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.507500 (+ 2833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.507505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.509879 (+ 2374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.509894 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.512257 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.512263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.512440 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.512474 (+ 34us) client_negotiation.cc:769] Sending connection context
0923 19:46:39.512541 (+ 67us) client_negotiation.cc:240] Negotiation successful
0923 19:46:39.512624 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13905,"mutex_wait_us":46,"thread_start_us":13734,"threads_started":1}
I20260923 19:46:39.513121 1512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.489502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44640 (local address 127.13.88.193:43699)
0923 19:46:39.490035 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.490044 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.503200 (+ 13156us) server_negotiation.cc:407] Connection header received
0923 19:46:39.503561 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.503574 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.503911 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.504115 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:39.504821 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.507359 (+ 2538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.510110 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.511897 (+ 1787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.512032 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.512259 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.512601 (+ 342us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.512785 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":293,"threads_started":1}
I20260923 19:46:39.516784 1171 tablet_service.cc:1467] Processing CreateTablet for tablet 41552ebf4ea54f0680a114e90e2fa6e2 (DEFAULT_TABLE table=test-table [id=e36ed52f849f4fa088f54b3690a15bbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:39.517649 1302 tablet_service.cc:1467] Processing CreateTablet for tablet 41552ebf4ea54f0680a114e90e2fa6e2 (DEFAULT_TABLE table=test-table [id=e36ed52f849f4fa088f54b3690a15bbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:46:39.518246 1171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41552ebf4ea54f0680a114e90e2fa6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:39.519035 1302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41552ebf4ea54f0680a114e90e2fa6e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:39.522343 1515 tablet_bootstrap.cc:492] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Bootstrap starting.
I20260923 19:46:39.526367 1515 tablet_bootstrap.cc:654] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:39.527431 1515 log.cc:824] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:39.529990 1515 tablet_bootstrap.cc:492] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: No bootstrap required, opened a new log
I20260923 19:46:39.530252 1515 ts_tablet_manager.cc:1397] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260923 19:46:39.532800 1517 tablet_bootstrap.cc:492] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Bootstrap starting.
I20260923 19:46:39.533835 1518 tablet_bootstrap.cc:492] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Bootstrap starting.
I20260923 19:46:39.536464 1517 tablet_bootstrap.cc:654] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:39.536640 1518 tablet_bootstrap.cc:654] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:39.537701 1518 log.cc:824] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:39.537708 1517 log.cc:824] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:39.540584 1517 tablet_bootstrap.cc:492] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: No bootstrap required, opened a new log
I20260923 19:46:39.540762 1518 tablet_bootstrap.cc:492] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: No bootstrap required, opened a new log
I20260923 19:46:39.540869 1517 ts_tablet_manager.cc:1397] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260923 19:46:39.541011 1518 ts_tablet_manager.cc:1397] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260923 19:46:39.542227 1515 raft_consensus.cc:348] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.542697 1515 raft_consensus.cc:374] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:39.542791 1515 raft_consensus.cc:729] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7318da0efc4ec2be8de8fdf578f652, State: Initialized, Role: FOLLOWER
I20260923 19:46:39.543416 1515 consensus_queue.cc:260] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.552630 1517 raft_consensus.cc:348] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.553160 1517 raft_consensus.cc:374] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:39.553197 1515 ts_tablet_manager.cc:1428] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Time spent starting tablet: real 0.023s user 0.019s sys 0.001s
I20260923 19:46:39.553287 1517 raft_consensus.cc:729] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 845d87cf78bb47a3bd522917c2b04d77, State: Initialized, Role: FOLLOWER
I20260923 19:46:39.553383 1518 raft_consensus.cc:348] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.553687 1497 heartbeater.cc:503] Master 127.13.88.254:41837 was elected leader, sending a full tablet report...
I20260923 19:46:39.553893 1518 raft_consensus.cc:374] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:39.554051 1518 raft_consensus.cc:729] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d31be9971b74100a96d75ebdc13a30c, State: Initialized, Role: FOLLOWER
I20260923 19:46:39.554023 1517 consensus_queue.cc:260] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.554721 1518 consensus_queue.cc:260] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.555938 1236 heartbeater.cc:503] Master 127.13.88.254:41837 was elected leader, sending a full tablet report...
I20260923 19:46:39.559778 1517 ts_tablet_manager.cc:1428] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Time spent starting tablet: real 0.019s user 0.008s sys 0.005s
I20260923 19:46:39.562549 1367 heartbeater.cc:503] Master 127.13.88.254:41837 was elected leader, sending a full tablet report...
I20260923 19:46:39.563069 1518 ts_tablet_manager.cc:1428] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Time spent starting tablet: real 0.022s user 0.015s sys 0.004s
I20260923 19:46:39.628008 1522 raft_consensus.cc:482] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:46:39.628320 1522 raft_consensus.cc:504] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.629969 1522 leader_election.cc:288] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7318da0efc4ec2be8de8fdf578f652 (127.13.88.195:37249), 5d31be9971b74100a96d75ebdc13a30c (127.13.88.194:35355)
I20260923 19:46:39.636914 1524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.630332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.195:37249 (local address 127.13.88.193:35835)
0923 19:46:39.630965 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.630980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:39.631183 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:39.631635 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:39.631638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:39.631663 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:39.632003 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.632015 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.633240 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.633245 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.634758 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.634769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.636017 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.636024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.636206 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.636239 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 19:46:39.636492 (+ 253us) client_negotiation.cc:240] Negotiation successful
0923 19:46:39.636621 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":378,"threads_started":1}
I20260923 19:46:39.636911 1510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.630359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:35835 (local address 127.13.88.195:37249)
0923 19:46:39.630592 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.630602 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.631130 (+ 528us) server_negotiation.cc:407] Connection header received
0923 19:46:39.631357 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.631364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.631457 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.631550 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:39.632176 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.633108 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.634957 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.635846 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.635967 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.636015 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.636518 (+ 503us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.636649 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:46:39.637241 1514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.631328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.13.88.193:42871 (local address 127.13.88.194:35355)
0923 19:46:39.631539 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.631544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.631869 (+ 325us) server_negotiation.cc:407] Connection header received
0923 19:46:39.632000 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.632005 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.632096 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.632183 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 19:46:39.632783 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.633598 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.635380 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.636235 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.636407 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.636497 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.636840 (+ 343us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.636985 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 19:46:39.637250 1525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.631140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.194:35355 (local address 127.13.88.193:42871)
0923 19:46:39.631751 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.631764 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 19:46:39.631876 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:46:39.632210 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:46:39.632216 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:46:39.632242 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 19:46:39.632629 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.632640 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.633718 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.633724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.635155 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:46:39.635168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.636458 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.636484 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:46:39.636656 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.636685 (+ 29us) client_negotiation.cc:769] Sending connection context
0923 19:46:39.636774 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 19:46:39.636882 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":293,"threads_started":1}
I20260923 19:46:39.638231 1322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41552ebf4ea54f0680a114e90e2fa6e2" candidate_uuid: "845d87cf78bb47a3bd522917c2b04d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d31be9971b74100a96d75ebdc13a30c" is_pre_election: true
I20260923 19:46:39.638235 1452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41552ebf4ea54f0680a114e90e2fa6e2" candidate_uuid: "845d87cf78bb47a3bd522917c2b04d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7318da0efc4ec2be8de8fdf578f652" is_pre_election: true
I20260923 19:46:39.638718 1322 raft_consensus.cc:2454] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 845d87cf78bb47a3bd522917c2b04d77 in term 0.
I20260923 19:46:39.638724 1452 raft_consensus.cc:2454] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 845d87cf78bb47a3bd522917c2b04d77 in term 0.
I20260923 19:46:39.639350 1124 leader_election.cc:302] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d31be9971b74100a96d75ebdc13a30c, 845d87cf78bb47a3bd522917c2b04d77; no voters:
I20260923 19:46:39.639709 1522 raft_consensus.cc:2781] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:46:39.639868 1522 raft_consensus.cc:482] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:46:39.639971 1522 raft_consensus.cc:3037] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:39.642163 1522 raft_consensus.cc:504] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.642714 1522 leader_election.cc:288] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [CANDIDATE]: Term 1 election: Requested vote from peers 1c7318da0efc4ec2be8de8fdf578f652 (127.13.88.195:37249), 5d31be9971b74100a96d75ebdc13a30c (127.13.88.194:35355)
I20260923 19:46:39.643230 1452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41552ebf4ea54f0680a114e90e2fa6e2" candidate_uuid: "845d87cf78bb47a3bd522917c2b04d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7318da0efc4ec2be8de8fdf578f652"
I20260923 19:46:39.643383 1322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41552ebf4ea54f0680a114e90e2fa6e2" candidate_uuid: "845d87cf78bb47a3bd522917c2b04d77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d31be9971b74100a96d75ebdc13a30c"
I20260923 19:46:39.643415 1452 raft_consensus.cc:3037] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:39.643580 1322 raft_consensus.cc:3037] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:39.645599 1452 raft_consensus.cc:2454] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 845d87cf78bb47a3bd522917c2b04d77 in term 1.
I20260923 19:46:39.645905 1322 raft_consensus.cc:2454] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 845d87cf78bb47a3bd522917c2b04d77 in term 1.
I20260923 19:46:39.645963 1124 leader_election.cc:302] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7318da0efc4ec2be8de8fdf578f652, 845d87cf78bb47a3bd522917c2b04d77; no voters:
I20260923 19:46:39.646229 1522 raft_consensus.cc:2781] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:39.646658 1522 raft_consensus.cc:686] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 1 LEADER]: Becoming Leader. State: Replica: 845d87cf78bb47a3bd522917c2b04d77, State: Running, Role: LEADER
I20260923 19:46:39.647164 1522 consensus_queue.cc:237] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } }
I20260923 19:46:39.651710 1048 catalog_manager.cc:5495] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 reported cstate change: term changed from 0 to 1, leader changed from <none> to 845d87cf78bb47a3bd522917c2b04d77 (127.13.88.193). New cstate: current_term: 1 leader_uuid: "845d87cf78bb47a3bd522917c2b04d77" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "845d87cf78bb47a3bd522917c2b04d77" member_type: VOTER last_known_addr { host: "127.13.88.193" port: 43699 } health_report { overall_health: HEALTHY } } }
I20260923 19:46:39.667361 1512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.661462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44650 (local address 127.13.88.193:43699)
0923 19:46:39.661674 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.661680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.661783 (+ 103us) server_negotiation.cc:407] Connection header received
0923 19:46:39.662032 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.662036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.662125 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.662276 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:46:39.662629 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.663815 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.665191 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.665616 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.665758 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.666236 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:46:39.666725 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:46:39.666898 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.666950 (+ 52us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.667034 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:46:39.677273 1322 raft_consensus.cc:1261] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 1 FOLLOWER]: Refusing update from remote peer 845d87cf78bb47a3bd522917c2b04d77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:39.677273 1452 raft_consensus.cc:1261] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 1 FOLLOWER]: Refusing update from remote peer 845d87cf78bb47a3bd522917c2b04d77: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:46:39.678241 1526 consensus_queue.cc:1035] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d31be9971b74100a96d75ebdc13a30c" member_type: VOTER last_known_addr { host: "127.13.88.194" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:46:39.678602 1522 consensus_queue.cc:1035] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7318da0efc4ec2be8de8fdf578f652" member_type: VOTER last_known_addr { host: "127.13.88.195" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:46:39.685060 1498 tablet.cc:2369] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:46:39.693368 1530 mvcc.cc:205] Tried to move back new op lower bound from 7332629707467280384 to 7332629707358396416. Current Snapshot: MvccSnapshot[applied={T|T < 7332629707467280384}]
I20260923 19:46:39.705567 1049 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:39.705899 1049 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 19:46:39.709537 1049 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dae2b299a5cb4a3fb6f4d6b82314496a: Sending DeleteTablet for 3 replicas of tablet 41552ebf4ea54f0680a114e90e2fa6e2
I20260923 19:46:39.710609 1432 tablet_service.cc:1514] Processing DeleteTablet for tablet 41552ebf4ea54f0680a114e90e2fa6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:39 UTC) from {username='slave'} at 127.0.0.1:56430
I20260923 19:46:39.710791 1302 tablet_service.cc:1514] Processing DeleteTablet for tablet 41552ebf4ea54f0680a114e90e2fa6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:39 UTC) from {username='slave'} at 127.0.0.1:39754
I20260923 19:46:39.710819 1171 tablet_service.cc:1514] Processing DeleteTablet for tablet 41552ebf4ea54f0680a114e90e2fa6e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:46:39 UTC) from {username='slave'} at 127.0.0.1:44640
I20260923 19:46:39.712634 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1109
I20260923 19:46:39.724046 1541 tablet_replica.cc:330] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: stopping tablet replica
I20260923 19:46:39.724617 1541 raft_consensus.cc:2229] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:46:39.725512 1541 raft_consensus.cc:2258] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:39.727396 1539 tablet_replica.cc:330] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: stopping tablet replica
I20260923 19:46:39.727905 1539 raft_consensus.cc:2229] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:39.728159 1541 ts_tablet_manager.cc:1905] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:39.728422 1539 raft_consensus.cc:2258] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:39.729611 1540 tablet_replica.cc:330] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: stopping tablet replica
I20260923 19:46:39.730990 1539 ts_tablet_manager.cc:1905] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:39.731491 1540 raft_consensus.cc:2229] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:46:39.732030 1540 raft_consensus.cc:2258] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:46:39.735127 1512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.715073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.13.88.193:43699)
0923 19:46:39.715530 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.715536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.726648 (+ 11112us) server_negotiation.cc:407] Connection header received
0923 19:46:39.726926 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.726933 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.727051 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.727194 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:39.727964 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.729161 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.731074 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.731790 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.731885 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.733349 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:39.733358 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:39.733374 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:39.734176 (+ 802us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:39.734231 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:39.734269 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:39.734355 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.734612 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.734714 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339}
I20260923 19:46:39.736523 1231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:39.739673 1540 ts_tablet_manager.cc:1905] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:46:39.740280 1539 ts_tablet_manager.cc:1918] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:39.740440 1539 log.cc:1196] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-2/wal/wals/41552ebf4ea54f0680a114e90e2fa6e2
I20260923 19:46:39.740957 1539 ts_tablet_manager.cc:1939] T 41552ebf4ea54f0680a114e90e2fa6e2 P 1c7318da0efc4ec2be8de8fdf578f652: Deleting consensus metadata
I20260923 19:46:39.742465 1033 catalog_manager.cc:4841] TS 1c7318da0efc4ec2be8de8fdf578f652 (127.13.88.195:37249): tablet 41552ebf4ea54f0680a114e90e2fa6e2 (table test-table [id=e36ed52f849f4fa088f54b3690a15bbf]) successfully deleted
I20260923 19:46:39.747136 1540 ts_tablet_manager.cc:1918] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:39.747352 1540 log.cc:1196] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-1/wal/wals/41552ebf4ea54f0680a114e90e2fa6e2
I20260923 19:46:39.747932 1540 ts_tablet_manager.cc:1939] T 41552ebf4ea54f0680a114e90e2fa6e2 P 5d31be9971b74100a96d75ebdc13a30c: Deleting consensus metadata
I20260923 19:46:39.749919 1033 catalog_manager.cc:4841] TS 5d31be9971b74100a96d75ebdc13a30c (127.13.88.194:35355): tablet 41552ebf4ea54f0680a114e90e2fa6e2 (table test-table [id=e36ed52f849f4fa088f54b3690a15bbf]) successfully deleted
I20260923 19:46:39.833807 1541 ts_tablet_manager.cc:1918] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:46:39.834095 1541 log.cc:1196] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Deleting WAL directory at /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790192489293654-13667-0/minicluster-data/ts-0/wal/wals/41552ebf4ea54f0680a114e90e2fa6e2
I20260923 19:46:39.834534 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1109
I20260923 19:46:39.834722 1541 ts_tablet_manager.cc:1939] T 41552ebf4ea54f0680a114e90e2fa6e2 P 845d87cf78bb47a3bd522917c2b04d77: Deleting consensus metadata
W20260923 19:46:39.853257 1034 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.13.88.193:43699 (error 108)
I20260923 19:46:39.853375 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1240
I20260923 19:46:39.855235 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.854714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44660)
0923 19:46:39.854918 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.855043 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260923 19:46:39.855482 1034 catalog_manager.cc:4584] TS 845d87cf78bb47a3bd522917c2b04d77 (127.13.88.193:43699): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 41552ebf4ea54f0680a114e90e2fa6e2: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
I20260923 19:46:39.863241 1514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.854187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39758 (local address 127.13.88.194:35355)
0923 19:46:39.854355 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.854359 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.854403 (+ 44us) server_negotiation.cc:407] Connection header received
0923 19:46:39.854639 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.854645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.854748 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.854859 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:39.855345 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.856172 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.857321 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.857690 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.857781 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.861891 (+ 4110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:39.861901 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:39.861928 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:39.862510 (+ 582us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:39.862557 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:39.862576 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:39.862660 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.862769 (+ 109us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.862856 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 19:46:39.863986 1362 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:39.909039 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.908559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44664)
0923 19:46:39.908780 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.908873 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260923 19:46:39.910058 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.909680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44680)
0923 19:46:39.909872 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.909934 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260923 19:46:39.951042 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1240
I20260923 19:46:39.967442 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1370
I20260923 19:46:39.970628 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.970130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44684)
0923 19:46:39.970325 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.970421 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260923 19:46:39.971664 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.971323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44700)
0923 19:46:39.971493 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:39.971558 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 19:46:39.974143 1510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:39.968178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56446 (local address 127.13.88.195:37249)
0923 19:46:39.968345 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:39.968350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:39.968367 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:46:39.968495 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:39.968498 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:39.968628 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:39.968729 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:39.969101 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.969834 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.971486 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:39.971944 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:39.972052 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:39.973027 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:39.973034 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:39.973049 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:39.973593 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:39.973636 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:39.973654 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:39.973741 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:39.973860 (+ 119us) server_negotiation.cc:299] Negotiation successful
0923 19:46:39.973942 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 19:46:39.974759 1492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:40.052863 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:40.052200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44710)
0923 19:46:40.052440 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:40.052602 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 19:46:40.054734 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:40.053587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.193:43699 (local address 127.0.0.1:44712)
0923 19:46:40.053807 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0923 19:46:40.053898 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.193:43699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260923 19:46:40.075235 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1370
I20260923 19:46:40.091261 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1018
I20260923 19:46:40.092317 1079 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:40.200277 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1018
2026-09-23T19:46:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2724 ms)
[----------] 6 tests from EncryptionPolicyTest (20781 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:40 dist-test-slave-xg7f krb5kdc[1550](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:40 dist-test-slave-xg7f krb5kdc[1550](info): set up 2 sockets
Sep 23 19:46:40 dist-test-slave-xg7f krb5kdc[1550](info): commencing operation
krb5kdc: starting...
W20260923 19:46:41.303480 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:41 dist-test-slave-xg7f krb5kdc[1550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:41.540422 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46879
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:41.864204 1563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:41.864485 1563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:41.864601 1563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:41.872013 1563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:41.872129 1563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:41.872210 1563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:41.872304 1563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:41.872392 1563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:41.882352 1563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46879
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:41.883697 1563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:41.885010 1563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:41.896654 1568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:41.896675 1571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:41.896627 1569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:41.897398 1563 server_base.cc:1034] running on GCE node
I20260923 19:46:41.898152 1563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:41.899814 1563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:41.901021 1563 hybrid_clock.cc:648] HybridClock initialized: now 1790192801900969 us; error 40 us; skew 500 ppm
I20260923 19:46:41.901360 1563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:41 dist-test-slave-xg7f krb5kdc[1550](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192801, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:41.904549 1563 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:41.906006 1563 webserver.cc:460] Webserver started at http://127.0.0.1:32975/ using document root <none> and password file <none>
I20260923 19:46:41.906733 1563 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:41.906883 1563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:41.907272 1563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:41.910238 1563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "27cc4518449c448d929ddd9c7d05ed08"
format_stamp: "Formatted at 2026-09-23 19:46:41 on dist-test-slave-xg7f"
server_key: "a9e4e3e291768dc8be7617108dcfff6c"
server_key_iv: "fb789954837c3666fb9f84746cc98c58"
server_key_version: "encryptionkey@0"
I20260923 19:46:41.911033 1563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "27cc4518449c448d929ddd9c7d05ed08"
format_stamp: "Formatted at 2026-09-23 19:46:41 on dist-test-slave-xg7f"
server_key: "a9e4e3e291768dc8be7617108dcfff6c"
server_key_iv: "fb789954837c3666fb9f84746cc98c58"
server_key_version: "encryptionkey@0"
I20260923 19:46:41.916208 1563 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:46:41.919556 1578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:41.920818 1563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:46:41.921011 1563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "27cc4518449c448d929ddd9c7d05ed08"
format_stamp: "Formatted at 2026-09-23 19:46:41 on dist-test-slave-xg7f"
server_key: "a9e4e3e291768dc8be7617108dcfff6c"
server_key_iv: "fb789954837c3666fb9f84746cc98c58"
server_key_version: "encryptionkey@0"
I20260923 19:46:41.921195 1563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:41.941685 1563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:41.945798 1563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:41.946069 1563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:41.964349 1563 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46879
I20260923 19:46:41.964372 1629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46879 every 8 connection(s)
I20260923 19:46:41.965724 1563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:41.969408 1630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:41.972523 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1563
I20260923 19:46:41.972720 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:41.973340 13667 external_mini_cluster.cc:1428] Setting key 83cec9c8bb5ca7e2945c3d3aa7e5d546
I20260923 19:46:41.982398 1630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08: Bootstrap starting.
I20260923 19:46:41.986001 1630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:41.986995 1630 log.cc:824] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08: Log is configured to *not* fsync() on all Append() calls
Sep 23 19:46:41 dist-test-slave-xg7f krb5kdc[1550](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:46:41.990141 1630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08: No bootstrap required, opened a new log
I20260923 19:46:41.997051 1633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:41.975264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36297 (local address 127.0.0.1:46879)
0923 19:46:41.976074 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:41.976087 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:41.976132 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:46:41.978117 (+ 1985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:41.978145 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:41.978672 (+ 527us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:41.979141 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:41.980378 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:41.982310 (+ 1932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:41.983778 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:41.984852 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:41.985039 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:41.989514 (+ 4475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:41.989522 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:41.989536 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:41.989573 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:41.992753 (+ 3180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:41.993709 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:41.993716 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:41.993721 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:41.993894 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:41.994366 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:41.994369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:41.994371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:41.994879 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:41.995184 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:41.995649 (+ 465us) server_negotiation.cc:299] Negotiation successful
0923 19:46:41.995989 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":353,"threads_started":1}
I20260923 19:46:41.999049 1630 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27cc4518449c448d929ddd9c7d05ed08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46879 } }
I20260923 19:46:41.999482 1630 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:41.999661 1630 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27cc4518449c448d929ddd9c7d05ed08, State: Initialized, Role: FOLLOWER
I20260923 19:46:42.000471 1630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27cc4518449c448d929ddd9c7d05ed08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46879 } }
I20260923 19:46:42.000720 1630 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:42.000908 1630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:42.001096 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:42.001101 1630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:42.003369 1630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27cc4518449c448d929ddd9c7d05ed08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46879 } }
I20260923 19:46:42.003865 1630 leader_election.cc:302] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27cc4518449c448d929ddd9c7d05ed08; no voters:
I20260923 19:46:42.004534 1630 leader_election.cc:288] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:42.004638 1637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:42.007161 1630 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:42.007404 1637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [term 1 LEADER]: Becoming Leader. State: Replica: 27cc4518449c448d929ddd9c7d05ed08, State: Running, Role: LEADER
I20260923 19:46:42.008090 1637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27cc4518449c448d929ddd9c7d05ed08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46879 } }
I20260923 19:46:42.011418 1641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27cc4518449c448d929ddd9c7d05ed08. Latest consensus state: current_term: 1 leader_uuid: "27cc4518449c448d929ddd9c7d05ed08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27cc4518449c448d929ddd9c7d05ed08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46879 } } }
I20260923 19:46:42.011899 1641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:42.012694 1640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27cc4518449c448d929ddd9c7d05ed08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27cc4518449c448d929ddd9c7d05ed08" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46879 } } }
I20260923 19:46:42.013038 1640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:42.034566 1646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:42.048807 1646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:42.067991 1633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:42.009424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48183 (local address 127.0.0.1:46879)
0923 19:46:42.009633 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:42.009642 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:42.044272 (+ 34630us) server_negotiation.cc:407] Connection header received
0923 19:46:42.044530 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:42.044539 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:42.044662 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:42.044820 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:42.047613 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:42.049236 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:42.051145 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:42.051834 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:42.051951 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:42.055313 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:42.055323 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:42.055328 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:42.055370 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:42.060368 (+ 4998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:42.064442 (+ 4074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:42.064452 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:42.064458 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:42.065047 (+ 589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:42.065668 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:42.065673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:42.065676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:42.066404 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:42.066678 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:42.067433 (+ 755us) server_negotiation.cc:299] Negotiation successful
0923 19:46:42.067621 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:46:42.068483 1646 catalog_manager.cc:1347] Generated new cluster ID: ce5baeeb20cf46c1be64cc117f1b2764
I20260923 19:46:42.068605 1646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:42.088737 1646 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:42.090673 1646 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:42.108577 1646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27cc4518449c448d929ddd9c7d05ed08: Generated new TSK 0
I20260923 19:46:42.109671 1646 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:42.116865 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1563
I20260923 19:46:42.118068 1625 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:42.209406 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1563
W20260923 19:46:42.227213 1548 connection.cc:535] client connection to 127.0.0.1:46879 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46879): Connection reset by peer (error 104)
2026-09-23T19:46:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2001 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:42 dist-test-slave-xg7f krb5kdc[1663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:42 dist-test-slave-xg7f krb5kdc[1663](info): set up 2 sockets
Sep 23 19:46:42 dist-test-slave-xg7f krb5kdc[1663](info): commencing operation
krb5kdc: starting...
W20260923 19:46:43.291517 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:43 dist-test-slave-xg7f krb5kdc[1663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:43.530393 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37409
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:43.863266 1676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:43.863616 1676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:43.863785 1676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:43.870929 1676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:43.871089 1676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:43.871212 1676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:43.871313 1676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:43.871383 1676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:43.881191 1676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37409
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:43.882540 1676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:43.883844 1676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:43.895520 1682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:43.895612 1684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:43.895866 1681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:43.896672 1676 server_base.cc:1034] running on GCE node
I20260923 19:46:43.897500 1676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:43.898859 1676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:43.900079 1676 hybrid_clock.cc:648] HybridClock initialized: now 1790192803900015 us; error 75 us; skew 500 ppm
I20260923 19:46:43.900422 1676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:43 dist-test-slave-xg7f krb5kdc[1663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192803, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:43.903558 1676 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:43.905050 1676 webserver.cc:460] Webserver started at http://127.0.0.1:33085/ using document root <none> and password file <none>
I20260923 19:46:43.905726 1676 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:43.905874 1676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:43.906183 1676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:43.909229 1676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "e57de00b2333413ab3ac0d04292b0937"
format_stamp: "Formatted at 2026-09-23 19:46:43 on dist-test-slave-xg7f"
server_key: "acb155516686e22ceaf61e3e4fd27739"
server_key_iv: "42570f4bb2d1880f9b37610508e49260"
server_key_version: "encryptionkey@0"
I20260923 19:46:43.910009 1676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "e57de00b2333413ab3ac0d04292b0937"
format_stamp: "Formatted at 2026-09-23 19:46:43 on dist-test-slave-xg7f"
server_key: "acb155516686e22ceaf61e3e4fd27739"
server_key_iv: "42570f4bb2d1880f9b37610508e49260"
server_key_version: "encryptionkey@0"
I20260923 19:46:43.915723 1676 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:46:43.919211 1691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:43.920501 1676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:46:43.920676 1676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "e57de00b2333413ab3ac0d04292b0937"
format_stamp: "Formatted at 2026-09-23 19:46:43 on dist-test-slave-xg7f"
server_key: "acb155516686e22ceaf61e3e4fd27739"
server_key_iv: "42570f4bb2d1880f9b37610508e49260"
server_key_version: "encryptionkey@0"
I20260923 19:46:43.920882 1676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:43.958678 1676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:43.963246 1676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:43.963510 1676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:43.982184 1676 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37409
I20260923 19:46:43.982219 1742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37409 every 8 connection(s)
I20260923 19:46:43.983596 1676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:43.987329 1743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:43.993666 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1676
I20260923 19:46:43.993863 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:43.994423 13667 external_mini_cluster.cc:1428] Setting key 869b7f7b4cacc806c0dc341465f85d13
I20260923 19:46:43.998366 1743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937: Bootstrap starting.
I20260923 19:46:44.001904 1743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:44.003223 1743 log.cc:824] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:44.006487 1743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937: No bootstrap required, opened a new log
I20260923 19:46:44.008203 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:43.996254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39239 (local address 127.0.0.1:37409)
0923 19:46:43.997041 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:43.997052 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:43.997092 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:46:43.998779 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:43.998800 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:43.999229 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:43.999540 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:44.000180 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:44.001479 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:44.003458 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:44.004549 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:44.004685 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:44.005951 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:44.005958 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:44.005972 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:44.006495 (+ 523us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:44.006576 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:44.006626 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:44.006760 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:44.007039 (+ 279us) server_negotiation.cc:299] Negotiation successful
0923 19:46:44.007281 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":386,"threads_started":1}
I20260923 19:46:44.011974 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:44.015884 1743 raft_consensus.cc:348] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57de00b2333413ab3ac0d04292b0937" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37409 } }
I20260923 19:46:44.016408 1743 raft_consensus.cc:374] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:44.016517 1743 raft_consensus.cc:729] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e57de00b2333413ab3ac0d04292b0937, State: Initialized, Role: FOLLOWER
I20260923 19:46:44.017220 1743 consensus_queue.cc:260] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57de00b2333413ab3ac0d04292b0937" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37409 } }
I20260923 19:46:44.017524 1743 raft_consensus.cc:388] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:44.017712 1743 raft_consensus.cc:482] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:44.017905 1743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:44.020396 1743 raft_consensus.cc:504] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57de00b2333413ab3ac0d04292b0937" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37409 } }
I20260923 19:46:44.020918 1743 leader_election.cc:302] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e57de00b2333413ab3ac0d04292b0937; no voters:
I20260923 19:46:44.021641 1743 leader_election.cc:288] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:44.021768 1753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:44.024425 1743 sys_catalog.cc:564] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:44.024523 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:44.017307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37433 (local address 127.0.0.1:37409)
0923 19:46:44.017501 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:44.017513 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:44.018038 (+ 525us) server_negotiation.cc:407] Connection header received
0923 19:46:44.018269 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:44.018275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:44.018346 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:44.018454 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:44.018998 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:44.019912 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:44.021380 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:44.021955 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:44.022121 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:44.023601 (+ 1480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:44.023608 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:44.023612 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:44.023639 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:44.023695 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:44.023710 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:44.023832 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:44.024066 (+ 234us) server_negotiation.cc:299] Negotiation successful
0923 19:46:44.024138 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:46:44.027181 1753 raft_consensus.cc:686] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [term 1 LEADER]: Becoming Leader. State: Replica: e57de00b2333413ab3ac0d04292b0937, State: Running, Role: LEADER
I20260923 19:46:44.028002 1753 consensus_queue.cc:237] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57de00b2333413ab3ac0d04292b0937" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37409 } }
I20260923 19:46:44.031380 1755 sys_catalog.cc:455] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e57de00b2333413ab3ac0d04292b0937. Latest consensus state: current_term: 1 leader_uuid: "e57de00b2333413ab3ac0d04292b0937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57de00b2333413ab3ac0d04292b0937" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37409 } } }
I20260923 19:46:44.031795 1755 sys_catalog.cc:458] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:44.031412 1754 sys_catalog.cc:455] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e57de00b2333413ab3ac0d04292b0937" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57de00b2333413ab3ac0d04292b0937" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37409 } } }
I20260923 19:46:44.032603 1754 sys_catalog.cc:458] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937 [sys.catalog]: This master's current role is: LEADER
W20260923 19:46:44.037938 1767 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:46:44.038072 1767 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:46:44.038220 1768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:44.039896 1768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:44.048462 1768 catalog_manager.cc:1347] Generated new cluster ID: ff775917a80c4f5991ed0c8f51966845
I20260923 19:46:44.048565 1768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:44.068488 1768 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:44.070428 1768 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:44.077529 1768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e57de00b2333413ab3ac0d04292b0937: Generated new TSK 0
I20260923 19:46:44.078513 1768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:44.087958 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1676
W20260923 19:46:44.089249 1738 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39239
W20260923 19:46:44.089994 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1676: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:46:44.090186 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1676
W20260923 19:46:44.104139 1661 connection.cc:535] client connection to 127.0.0.1:37409 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37409): Connection reset by peer (error 104)
2026-09-23T19:46:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1876 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:44 dist-test-slave-xg7f krb5kdc[1774](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:44 dist-test-slave-xg7f krb5kdc[1774](info): set up 2 sockets
Sep 23 19:46:44 dist-test-slave-xg7f krb5kdc[1774](info): commencing operation
krb5kdc: starting...
W20260923 19:46:45.179399 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.007s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:45 dist-test-slave-xg7f krb5kdc[1774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:45.425844 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38779
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:45.749588 1787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:45.749919 1787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:45.750090 1787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:45.757198 1787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:45.757342 1787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:45.757445 1787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:45.757555 1787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:45.757655 1787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:45.767221 1787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38779
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:45.768501 1787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:45.769809 1787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:45.781399 1792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:45.781484 1795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:45.781463 1793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:45.782135 1787 server_base.cc:1034] running on GCE node
I20260923 19:46:45.782891 1787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:45.784382 1787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:45.785620 1787 hybrid_clock.cc:648] HybridClock initialized: now 1790192805785575 us; error 41 us; skew 500 ppm
I20260923 19:46:45.785996 1787 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:45 dist-test-slave-xg7f krb5kdc[1774](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192805, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:45.794497 1787 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:45.796062 1787 webserver.cc:460] Webserver started at http://127.0.0.1:35435/ using document root <none> and password file <none>
I20260923 19:46:45.796741 1787 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:45.796880 1787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:45.797178 1787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:45.800182 1787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "2d81f64216654ae8b380a9e4e8587d40"
format_stamp: "Formatted at 2026-09-23 19:46:45 on dist-test-slave-xg7f"
server_key: "07e006c1468d7fcb7aa010e90161002b"
server_key_iv: "788fe060514d17cb165f005ac9a662b7"
server_key_version: "encryptionkey@0"
I20260923 19:46:45.800908 1787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "2d81f64216654ae8b380a9e4e8587d40"
format_stamp: "Formatted at 2026-09-23 19:46:45 on dist-test-slave-xg7f"
server_key: "07e006c1468d7fcb7aa010e90161002b"
server_key_iv: "788fe060514d17cb165f005ac9a662b7"
server_key_version: "encryptionkey@0"
I20260923 19:46:45.805867 1787 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:46:45.809337 1802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:45.810535 1787 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:46:45.810781 1787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "2d81f64216654ae8b380a9e4e8587d40"
format_stamp: "Formatted at 2026-09-23 19:46:45 on dist-test-slave-xg7f"
server_key: "07e006c1468d7fcb7aa010e90161002b"
server_key_iv: "788fe060514d17cb165f005ac9a662b7"
server_key_version: "encryptionkey@0"
I20260923 19:46:45.810977 1787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:45.816588 1787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:45.820441 1787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:45.820742 1787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:45.839311 1787 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38779
I20260923 19:46:45.839344 1853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38779 every 8 connection(s)
I20260923 19:46:45.840736 1787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:45.844429 1854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:45.849187 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1787
I20260923 19:46:45.849382 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:45.849819 13667 external_mini_cluster.cc:1428] Setting key 2dca2ceb6ca755e1508a3ac32b4b2a01
I20260923 19:46:45.855315 1854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40: Bootstrap starting.
I20260923 19:46:45.857401 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:45.851613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41513 (local address 127.0.0.1:38779)
0923 19:46:45.852415 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:45.852426 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:45.852469 (+ 43us) server_negotiation.cc:407] Connection header received
0923 19:46:45.854184 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:45.854206 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:45.854530 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:45.854837 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:45.855876 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:45.855882 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:45.855895 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:45.855914 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:45.855967 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:45.855985 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:45.856144 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:45.856284 (+ 140us) server_negotiation.cc:299] Negotiation successful
0923 19:46:45.856488 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":385,"threads_started":1}
I20260923 19:46:45.858908 1854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:45.860162 1854 log.cc:824] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:45.861284 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:45.862903 1854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40: No bootstrap required, opened a new log
I20260923 19:46:45.868248 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:45.865597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39141 (local address 127.0.0.1:38779)
0923 19:46:45.865843 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:45.865853 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:45.866229 (+ 376us) server_negotiation.cc:407] Connection header received
0923 19:46:45.866393 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:45.866396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:45.866439 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:45.866522 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:45.867520 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:45.867523 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:45.867530 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:45.867550 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:45.867587 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:45.867600 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:45.867686 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:45.867835 (+ 149us) server_negotiation.cc:299] Negotiation successful
0923 19:46:45.867879 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:46:45.871533 1854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d81f64216654ae8b380a9e4e8587d40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38779 } }
I20260923 19:46:45.871909 1854 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:45.872020 1854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d81f64216654ae8b380a9e4e8587d40, State: Initialized, Role: FOLLOWER
I20260923 19:46:45.872592 1854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d81f64216654ae8b380a9e4e8587d40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38779 } }
I20260923 19:46:45.872833 1854 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:45.872980 1854 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:45.873143 1854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:45.875486 1854 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d81f64216654ae8b380a9e4e8587d40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38779 } }
I20260923 19:46:45.875977 1854 leader_election.cc:302] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d81f64216654ae8b380a9e4e8587d40; no voters:
I20260923 19:46:45.876518 1854 leader_election.cc:288] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:45.876654 1864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:45.877297 1864 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [term 1 LEADER]: Becoming Leader. State: Replica: 2d81f64216654ae8b380a9e4e8587d40, State: Running, Role: LEADER
I20260923 19:46:45.877844 1864 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d81f64216654ae8b380a9e4e8587d40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38779 } }
I20260923 19:46:45.878587 1854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:45.880541 1865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d81f64216654ae8b380a9e4e8587d40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d81f64216654ae8b380a9e4e8587d40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38779 } } }
I20260923 19:46:45.881022 1865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:45.881095 1866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d81f64216654ae8b380a9e4e8587d40. Latest consensus state: current_term: 1 leader_uuid: "2d81f64216654ae8b380a9e4e8587d40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d81f64216654ae8b380a9e4e8587d40" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38779 } } }
I20260923 19:46:45.881453 1866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:45.883492 1869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:45.888492 1869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:45.897116 1869 catalog_manager.cc:1347] Generated new cluster ID: 16389e50b91449409d15e78ac7b3ab57
I20260923 19:46:45.897221 1869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:45.908341 1869 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:45.908797 1869 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:45.916539 1869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d81f64216654ae8b380a9e4e8587d40: Generated new TSK 0
I20260923 19:46:45.917270 1869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:45.927222 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1787
W20260923 19:46:45.928704 1849 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41513
W20260923 19:46:45.929385 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1787: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:46:45.929543 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1787
2026-09-23T19:46:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1841 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:46 dist-test-slave-xg7f krb5kdc[1885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:46 dist-test-slave-xg7f krb5kdc[1885](info): set up 2 sockets
Sep 23 19:46:46 dist-test-slave-xg7f krb5kdc[1885](info): commencing operation
krb5kdc: starting...
W20260923 19:46:47.011544 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.006s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:47 dist-test-slave-xg7f krb5kdc[1885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:47.249859 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38329
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:47.563961 1898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:47.564232 1898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:47.564421 1898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:47.571609 1898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:47.571745 1898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:47.571877 1898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:47.572011 1898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:47.572098 1898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:47.581799 1898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:47.583110 1898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:47.584450 1898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:47.595829 1906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:47.596076 1903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:47.596099 1904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:47.596832 1898 server_base.cc:1034] running on GCE node
I20260923 19:46:47.597604 1898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:47.598927 1898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:47.600145 1898 hybrid_clock.cc:648] HybridClock initialized: now 1790192807600115 us; error 46 us; skew 500 ppm
I20260923 19:46:47.600507 1898 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:47 dist-test-slave-xg7f krb5kdc[1885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192807, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:47.603490 1898 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:47.604933 1898 webserver.cc:460] Webserver started at http://127.0.0.1:40281/ using document root <none> and password file <none>
I20260923 19:46:47.605634 1898 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:47.605773 1898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:47.606092 1898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:47.609071 1898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "7c086c7d24a84e3b82afc9d178054fad"
format_stamp: "Formatted at 2026-09-23 19:46:47 on dist-test-slave-xg7f"
server_key: "ce510f3410fde067ae1761a859cf5b88"
server_key_iv: "d1fb9aab69a4854765ebc238c5e989b5"
server_key_version: "encryptionkey@0"
I20260923 19:46:47.609864 1898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "7c086c7d24a84e3b82afc9d178054fad"
format_stamp: "Formatted at 2026-09-23 19:46:47 on dist-test-slave-xg7f"
server_key: "ce510f3410fde067ae1761a859cf5b88"
server_key_iv: "d1fb9aab69a4854765ebc238c5e989b5"
server_key_version: "encryptionkey@0"
I20260923 19:46:47.614943 1898 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:46:47.618297 1913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:47.619635 1898 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:47.619831 1898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "7c086c7d24a84e3b82afc9d178054fad"
format_stamp: "Formatted at 2026-09-23 19:46:47 on dist-test-slave-xg7f"
server_key: "ce510f3410fde067ae1761a859cf5b88"
server_key_iv: "d1fb9aab69a4854765ebc238c5e989b5"
server_key_version: "encryptionkey@0"
I20260923 19:46:47.620020 1898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:47.654806 1898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:47.658772 1898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:47.659149 1898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:47.681380 1898 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38329
I20260923 19:46:47.681387 1964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38329 every 8 connection(s)
I20260923 19:46:47.682788 1898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:47.686383 1965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:47.692737 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 1898
I20260923 19:46:47.692938 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:47.693449 13667 external_mini_cluster.cc:1428] Setting key e47b251e3ad7ca4d843d4b8273e571a2
I20260923 19:46:47.697518 1965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad: Bootstrap starting.
I20260923 19:46:47.701162 1965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:47.702314 1965 log.cc:824] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:47.705331 1965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad: No bootstrap required, opened a new log
Sep 23 19:46:47 dist-test-slave-xg7f krb5kdc[1885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:46:47.713946 1965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c086c7d24a84e3b82afc9d178054fad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38329 } }
I20260923 19:46:47.714313 1965 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:47.714411 1965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c086c7d24a84e3b82afc9d178054fad, State: Initialized, Role: FOLLOWER
I20260923 19:46:47.715061 1965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c086c7d24a84e3b82afc9d178054fad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38329 } }
I20260923 19:46:47.715436 1965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:47.715597 1965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:47.715778 1965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:47.716857 1968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:47.695382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34711 (local address 127.0.0.1:38329)
0923 19:46:47.696189 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:47.696201 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:47.696243 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:46:47.697937 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:47.697959 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:47.698348 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:47.698648 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:47.700458 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:47.701816 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:47.703613 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:47.704258 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:47.704385 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:47.709077 (+ 4692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:47.709083 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:47.709100 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:47.709141 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:47.712363 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:47.713193 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:47.713199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:47.713206 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:47.713361 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:47.713784 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:47.713788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:47.713790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:47.714366 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:47.714679 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:47.715222 (+ 543us) server_negotiation.cc:299] Negotiation successful
0923 19:46:47.715835 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":381,"threads_started":1}
I20260923 19:46:47.718111 1965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c086c7d24a84e3b82afc9d178054fad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38329 } }
I20260923 19:46:47.718592 1965 leader_election.cc:302] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c086c7d24a84e3b82afc9d178054fad; no voters:
I20260923 19:46:47.719266 1965 leader_election.cc:288] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:47.719357 1970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:47.720492 1970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [term 1 LEADER]: Becoming Leader. State: Replica: 7c086c7d24a84e3b82afc9d178054fad, State: Running, Role: LEADER
I20260923 19:46:47.720594 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:47.721082 1970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c086c7d24a84e3b82afc9d178054fad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38329 } }
I20260923 19:46:47.721571 1965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:47.724002 1971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c086c7d24a84e3b82afc9d178054fad. Latest consensus state: current_term: 1 leader_uuid: "7c086c7d24a84e3b82afc9d178054fad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c086c7d24a84e3b82afc9d178054fad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38329 } } }
I20260923 19:46:47.724463 1971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:47.729218 1972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c086c7d24a84e3b82afc9d178054fad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c086c7d24a84e3b82afc9d178054fad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38329 } } }
I20260923 19:46:47.730074 1972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:47.733949 1976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:47.742779 1976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:47.765589 1968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:47.736422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44973 (local address 127.0.0.1:38329)
0923 19:46:47.736683 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:47.736691 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:47.743404 (+ 6713us) server_negotiation.cc:407] Connection header received
0923 19:46:47.744317 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:47.744327 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:47.744435 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:47.744530 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:47.747151 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:47.748544 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:47.751124 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:47.752086 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:47.752214 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:47.756608 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:47.756618 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:47.756625 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:47.756682 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:47.761649 (+ 4967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:47.763017 (+ 1368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:47.763022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:47.763026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:47.763199 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:47.763803 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:47.763811 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:47.763814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:47.764335 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:47.764601 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:47.764952 (+ 351us) server_negotiation.cc:299] Negotiation successful
0923 19:46:47.765176 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260923 19:46:47.766390 1976 catalog_manager.cc:1347] Generated new cluster ID: 99f3a91932cc49e88b82b7039e739e17
I20260923 19:46:47.766489 1976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:47.777925 1976 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:47.779542 1976 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:47.789444 1976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c086c7d24a84e3b82afc9d178054fad: Generated new TSK 0
I20260923 19:46:47.790508 1976 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:47.797272 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 1898
I20260923 19:46:47.798230 1960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:47.889477 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 1898
2026-09-23T19:46:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1960 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:47 dist-test-slave-xg7f krb5kdc[1997](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:47 dist-test-slave-xg7f krb5kdc[1997](info): set up 2 sockets
Sep 23 19:46:47 dist-test-slave-xg7f krb5kdc[1997](info): commencing operation
krb5kdc: starting...
W20260923 19:46:48.971577 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:49 dist-test-slave-xg7f krb5kdc[1997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:49.213676 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34953
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:49.533974 2010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:49.534235 2010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:49.534421 2010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:49.540984 2010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:49.541091 2010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:49.541184 2010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:49.541282 2010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:49.541358 2010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:49.550802 2010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:49.552076 2010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:49.553418 2010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:49.565101 2018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:49.565047 2016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:49.565141 2015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:49.565877 2010 server_base.cc:1034] running on GCE node
I20260923 19:46:49.566613 2010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:49.568073 2010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:49.569298 2010 hybrid_clock.cc:648] HybridClock initialized: now 1790192809569265 us; error 46 us; skew 500 ppm
I20260923 19:46:49.569640 2010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:49 dist-test-slave-xg7f krb5kdc[1997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192809, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:49.572818 2010 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:49.574186 2010 webserver.cc:460] Webserver started at http://127.0.0.1:33115/ using document root <none> and password file <none>
I20260923 19:46:49.574864 2010 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:49.574961 2010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:49.575290 2010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:49.578088 2010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f"
format_stamp: "Formatted at 2026-09-23 19:46:49 on dist-test-slave-xg7f"
server_key: "0a94d1434d6441b6c5b5af9123577d50"
server_key_iv: "a8b70f63fb16c07bd33351900df26a0a"
server_key_version: "encryptionkey@0"
I20260923 19:46:49.578795 2010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f"
format_stamp: "Formatted at 2026-09-23 19:46:49 on dist-test-slave-xg7f"
server_key: "0a94d1434d6441b6c5b5af9123577d50"
server_key_iv: "a8b70f63fb16c07bd33351900df26a0a"
server_key_version: "encryptionkey@0"
I20260923 19:46:49.583572 2010 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260923 19:46:49.586915 2025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:49.588169 2010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:46:49.588346 2010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f"
format_stamp: "Formatted at 2026-09-23 19:46:49 on dist-test-slave-xg7f"
server_key: "0a94d1434d6441b6c5b5af9123577d50"
server_key_iv: "a8b70f63fb16c07bd33351900df26a0a"
server_key_version: "encryptionkey@0"
I20260923 19:46:49.588518 2010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:49.600543 2010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:49.604835 2010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:49.605125 2010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:49.623207 2010 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34953
I20260923 19:46:49.623306 2076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34953 every 8 connection(s)
I20260923 19:46:49.624569 2010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:49.625694 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2010
I20260923 19:46:49.625903 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:49.626410 13667 external_mini_cluster.cc:1428] Setting key 20befb69674e6b9cef9f85bb097d577a
I20260923 19:46:49.629005 2077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:49.639290 2080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:49.628149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50803 (local address 127.0.0.1:34953)
0923 19:46:49.628945 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:49.628956 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:49.629003 (+ 47us) server_negotiation.cc:407] Connection header received
0923 19:46:49.630674 (+ 1671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:49.630694 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:49.631048 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:49.631437 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:49.632003 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:49.633274 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:49.635073 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:49.635746 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:49.635874 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:49.637054 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:49.637061 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:49.637073 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:49.637623 (+ 550us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:49.637688 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:49.637712 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:49.637798 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:49.638026 (+ 228us) server_negotiation.cc:299] Negotiation successful
0923 19:46:49.638303 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":407,"threads_started":1}
I20260923 19:46:49.640717 2077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f: Bootstrap starting.
I20260923 19:46:49.642763 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:49.643986 2077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:49.645112 2077 log.cc:824] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:49.647818 2077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f: No bootstrap required, opened a new log
I20260923 19:46:49.654367 2080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:49.647974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48113 (local address 127.0.0.1:34953)
0923 19:46:49.648170 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:49.648179 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:49.648510 (+ 331us) server_negotiation.cc:407] Connection header received
0923 19:46:49.648730 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:49.648734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:49.648787 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:49.648861 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:49.649494 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:49.650238 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:49.652123 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:49.652530 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:49.652619 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:49.653701 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:49.653706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:49.653709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:49.653726 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:49.653758 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:49.653771 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:49.653835 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:49.653987 (+ 152us) server_negotiation.cc:299] Negotiation successful
0923 19:46:49.654048 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 19:46:49.657040 2077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34953 } }
I20260923 19:46:49.657459 2077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:49.657577 2077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07eee3ff91d74b92b22a77f4ff5a4c2f, State: Initialized, Role: FOLLOWER
I20260923 19:46:49.658138 2077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34953 } }
I20260923 19:46:49.658360 2077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:49.658507 2077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:49.658667 2077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:49.660779 2077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34953 } }
I20260923 19:46:49.661270 2077 leader_election.cc:302] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07eee3ff91d74b92b22a77f4ff5a4c2f; no voters:
I20260923 19:46:49.661790 2077 leader_election.cc:288] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:49.661949 2087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:49.662616 2087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [term 1 LEADER]: Becoming Leader. State: Replica: 07eee3ff91d74b92b22a77f4ff5a4c2f, State: Running, Role: LEADER
I20260923 19:46:49.663266 2087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34953 } }
I20260923 19:46:49.664045 2077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:49.668455 2088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34953 } } }
I20260923 19:46:49.668864 2088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:49.672858 2089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07eee3ff91d74b92b22a77f4ff5a4c2f. Latest consensus state: current_term: 1 leader_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07eee3ff91d74b92b22a77f4ff5a4c2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34953 } } }
I20260923 19:46:49.673242 2089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:49.673955 2092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:49.680512 2092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:49.691157 2092 catalog_manager.cc:1347] Generated new cluster ID: 578e1a86f0884066b0b5646cbc2481e1
I20260923 19:46:49.691282 2092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:49.712323 2092 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:49.713531 2092 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:49.726329 2092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07eee3ff91d74b92b22a77f4ff5a4c2f: Generated new TSK 0
I20260923 19:46:49.727190 2092 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:49.736649 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2010
W20260923 19:46:49.737821 2072 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50803
W20260923 19:46:49.739027 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2010: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:46:49.739223 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2010
2026-09-23T19:46:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1849 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:49 dist-test-slave-xg7f krb5kdc[2109](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:49 dist-test-slave-xg7f krb5kdc[2109](info): set up 2 sockets
Sep 23 19:46:49 dist-test-slave-xg7f krb5kdc[2109](info): commencing operation
krb5kdc: starting...
W20260923 19:46:50.839488 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:50 dist-test-slave-xg7f krb5kdc[2109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:51.076418 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41067
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:51.393662 2122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:51.393960 2122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:51.394130 2122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:51.401299 2122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:51.401412 2122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:51.401535 2122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:51.401654 2122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:51.401738 2122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:51.414567 2122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:51.416008 2122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:51.417420 2122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:51.431859 2127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:51.431921 2128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:51.431921 2130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:51.432721 2122 server_base.cc:1034] running on GCE node
I20260923 19:46:51.433526 2122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:51.434927 2122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:51.436162 2122 hybrid_clock.cc:648] HybridClock initialized: now 1790192811436112 us; error 63 us; skew 500 ppm
I20260923 19:46:51.436545 2122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:51 dist-test-slave-xg7f krb5kdc[2109](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192811, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:51.444392 2122 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:51.445914 2122 webserver.cc:460] Webserver started at http://127.0.0.1:46793/ using document root <none> and password file <none>
I20260923 19:46:51.446595 2122 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:51.446751 2122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:51.447062 2122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:51.449991 2122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "29fddcf4fc6e43acad5d6e423988baa5"
format_stamp: "Formatted at 2026-09-23 19:46:51 on dist-test-slave-xg7f"
server_key: "f264820c19853afd99c1e0264d7fed34"
server_key_iv: "125cdaed924e53189cbfd5d22dd474de"
server_key_version: "encryptionkey@0"
I20260923 19:46:51.450781 2122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "29fddcf4fc6e43acad5d6e423988baa5"
format_stamp: "Formatted at 2026-09-23 19:46:51 on dist-test-slave-xg7f"
server_key: "f264820c19853afd99c1e0264d7fed34"
server_key_iv: "125cdaed924e53189cbfd5d22dd474de"
server_key_version: "encryptionkey@0"
I20260923 19:46:51.455907 2122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260923 19:46:51.459395 2137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:51.460659 2122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:46:51.460839 2122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "29fddcf4fc6e43acad5d6e423988baa5"
format_stamp: "Formatted at 2026-09-23 19:46:51 on dist-test-slave-xg7f"
server_key: "f264820c19853afd99c1e0264d7fed34"
server_key_iv: "125cdaed924e53189cbfd5d22dd474de"
server_key_version: "encryptionkey@0"
I20260923 19:46:51.461033 2122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:51.466416 2122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:51.470247 2122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:51.470475 2122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:51.488035 2122 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41067
I20260923 19:46:51.488072 2188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41067 every 8 connection(s)
I20260923 19:46:51.489411 2122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:51.493144 2189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:51.497970 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2122
I20260923 19:46:51.498178 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:51.498610 13667 external_mini_cluster.cc:1428] Setting key d84ea82633af10d7b3ebca0c6755c71e
I20260923 19:46:51.503690 2189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5: Bootstrap starting.
I20260923 19:46:51.506031 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:51.500348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57865 (local address 127.0.0.1:41067)
0923 19:46:51.501123 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:51.501134 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:51.501181 (+ 47us) server_negotiation.cc:407] Connection header received
0923 19:46:51.502768 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:51.502789 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:51.503189 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:51.503527 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:51.504523 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:51.504528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:51.504541 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:51.504554 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:51.504631 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:51.504650 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:51.504811 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:51.504918 (+ 107us) server_negotiation.cc:299] Negotiation successful
0923 19:46:51.505123 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":361,"threads_started":1}
I20260923 19:46:51.506991 2189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:51.508338 2189 log.cc:824] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:51.509996 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:51.511658 2189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5: No bootstrap required, opened a new log
I20260923 19:46:51.517553 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:51.515206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56079 (local address 127.0.0.1:41067)
0923 19:46:51.515360 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:51.515368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:51.515646 (+ 278us) server_negotiation.cc:407] Connection header received
0923 19:46:51.515802 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:51.515806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:51.515856 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:51.515935 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:51.516855 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:51.516859 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:51.516862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:51.516875 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:51.516916 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:51.516930 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:51.517025 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:51.517165 (+ 140us) server_negotiation.cc:299] Negotiation successful
0923 19:46:51.517218 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 19:46:51.520991 2189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29fddcf4fc6e43acad5d6e423988baa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260923 19:46:51.521420 2189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:51.521502 2189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29fddcf4fc6e43acad5d6e423988baa5, State: Initialized, Role: FOLLOWER
I20260923 19:46:51.522001 2189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29fddcf4fc6e43acad5d6e423988baa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260923 19:46:51.522235 2189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:51.522384 2189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:51.522580 2189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:51.524866 2189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29fddcf4fc6e43acad5d6e423988baa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260923 19:46:51.525372 2189 leader_election.cc:302] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29fddcf4fc6e43acad5d6e423988baa5; no voters:
I20260923 19:46:51.525925 2189 leader_election.cc:288] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:51.526067 2199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:51.526854 2199 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [term 1 LEADER]: Becoming Leader. State: Replica: 29fddcf4fc6e43acad5d6e423988baa5, State: Running, Role: LEADER
I20260923 19:46:51.527482 2199 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29fddcf4fc6e43acad5d6e423988baa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260923 19:46:51.528119 2189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:51.530989 2201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29fddcf4fc6e43acad5d6e423988baa5. Latest consensus state: current_term: 1 leader_uuid: "29fddcf4fc6e43acad5d6e423988baa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29fddcf4fc6e43acad5d6e423988baa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } } }
I20260923 19:46:51.531443 2201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:51.532191 2200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29fddcf4fc6e43acad5d6e423988baa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29fddcf4fc6e43acad5d6e423988baa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } } }
I20260923 19:46:51.532476 2200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:51.536288 2204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:51.542080 2204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:51.550724 2204 catalog_manager.cc:1347] Generated new cluster ID: dd3f4f2a37dc420ca3db474cf3ad4cac
I20260923 19:46:51.550846 2204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:51.569087 2204 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:51.569492 2204 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:51.575543 2204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29fddcf4fc6e43acad5d6e423988baa5: Generated new TSK 0
I20260923 19:46:51.576246 2204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:51.589406 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2122
W20260923 19:46:51.590444 2184 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57865
W20260923 19:46:51.591144 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2122: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:46:51.591298 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2122
2026-09-23T19:46:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1851 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:51 dist-test-slave-xg7f krb5kdc[2220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:51 dist-test-slave-xg7f krb5kdc[2220](info): set up 2 sockets
Sep 23 19:46:51 dist-test-slave-xg7f krb5kdc[2220](info): commencing operation
krb5kdc: starting...
W20260923 19:46:52.691543 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.005s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:52 dist-test-slave-xg7f krb5kdc[2220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:52.943763 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45475
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:53.276101 2233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:53.276396 2233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:53.276587 2233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:53.283897 2233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:53.284029 2233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:53.284129 2233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:53.284241 2233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:53.284319 2233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:53.294271 2233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:53.295674 2233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:53.297020 2233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:53.308384 2239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:53.309304 2238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:53.309420 2241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:53.310170 2233 server_base.cc:1034] running on GCE node
I20260923 19:46:53.310983 2233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:53.312424 2233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:53.313688 2233 hybrid_clock.cc:648] HybridClock initialized: now 1790192813313648 us; error 47 us; skew 500 ppm
I20260923 19:46:53.314057 2233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:53 dist-test-slave-xg7f krb5kdc[2220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192813, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:53.317050 2233 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:53.318531 2233 webserver.cc:460] Webserver started at http://127.0.0.1:40981/ using document root <none> and password file <none>
I20260923 19:46:53.319272 2233 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:53.319414 2233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:53.319734 2233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:53.322641 2233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "584157321d664f87a09d681323be9221"
format_stamp: "Formatted at 2026-09-23 19:46:53 on dist-test-slave-xg7f"
server_key: "c11eb4a00f56f6f5731ef1628b09be71"
server_key_iv: "a57d7684484fcb829da55245e2413045"
server_key_version: "encryptionkey@0"
I20260923 19:46:53.323459 2233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "584157321d664f87a09d681323be9221"
format_stamp: "Formatted at 2026-09-23 19:46:53 on dist-test-slave-xg7f"
server_key: "c11eb4a00f56f6f5731ef1628b09be71"
server_key_iv: "a57d7684484fcb829da55245e2413045"
server_key_version: "encryptionkey@0"
I20260923 19:46:53.328647 2233 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:46:53.332252 2248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:53.333541 2233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:46:53.333737 2233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "584157321d664f87a09d681323be9221"
format_stamp: "Formatted at 2026-09-23 19:46:53 on dist-test-slave-xg7f"
server_key: "c11eb4a00f56f6f5731ef1628b09be71"
server_key_iv: "a57d7684484fcb829da55245e2413045"
server_key_version: "encryptionkey@0"
I20260923 19:46:53.333936 2233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:53.370747 2233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:53.374651 2233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:53.374943 2233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:53.394181 2233 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45475
I20260923 19:46:53.394212 2299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45475 every 8 connection(s)
I20260923 19:46:53.395684 2233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:53.399345 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2233
I20260923 19:46:53.399542 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:53.399628 2300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:53.400013 13667 external_mini_cluster.cc:1428] Setting key eb349e8a257cdcdf5934db48a123945b
I20260923 19:46:53.414312 2300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221: Bootstrap starting.
Sep 23 19:46:53 dist-test-slave-xg7f krb5kdc[2220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:46:53.417855 2300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:53.418916 2300 log.cc:824] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:53.421778 2300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221: No bootstrap required, opened a new log
I20260923 19:46:53.423444 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:53.401867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:36737 (local address 127.0.0.1:45475)
0923 19:46:53.402660 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:53.402679 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:53.402733 (+ 54us) server_negotiation.cc:407] Connection header received
0923 19:46:53.404755 (+ 2022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:53.404784 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:53.405310 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:53.405754 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:53.407096 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:53.409209 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:53.410418 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:53.411618 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:53.411844 (+ 226us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:53.416092 (+ 4248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:53.416100 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:53.416116 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:53.416156 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:53.419344 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:53.420124 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:53.420130 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:53.420136 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:53.420305 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:53.420766 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:53.420771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:53.420776 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:53.421268 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:53.421615 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:53.422088 (+ 473us) server_negotiation.cc:299] Negotiation successful
0923 19:46:53.422423 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":313,"threads_started":1}
I20260923 19:46:53.427666 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:53.430656 2300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584157321d664f87a09d681323be9221" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45475 } }
I20260923 19:46:53.431028 2300 raft_consensus.cc:374] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:53.431164 2300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 584157321d664f87a09d681323be9221, State: Initialized, Role: FOLLOWER
I20260923 19:46:53.431764 2300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584157321d664f87a09d681323be9221" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45475 } }
I20260923 19:46:53.432114 2300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:53.432276 2300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:53.432462 2300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:53.435580 2300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584157321d664f87a09d681323be9221" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45475 } }
I20260923 19:46:53.436182 2300 leader_election.cc:302] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 584157321d664f87a09d681323be9221; no voters:
I20260923 19:46:53.436807 2300 leader_election.cc:288] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:53.436908 2310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:53.438494 2310 raft_consensus.cc:686] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [term 1 LEADER]: Becoming Leader. State: Replica: 584157321d664f87a09d681323be9221, State: Running, Role: LEADER
I20260923 19:46:53.439082 2310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584157321d664f87a09d681323be9221" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45475 } }
I20260923 19:46:53.439229 2300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:53.441627 2311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "584157321d664f87a09d681323be9221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584157321d664f87a09d681323be9221" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45475 } } }
I20260923 19:46:53.442040 2311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:53.447027 2312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 584157321d664f87a09d681323be9221. Latest consensus state: current_term: 1 leader_uuid: "584157321d664f87a09d681323be9221" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "584157321d664f87a09d681323be9221" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45475 } } }
I20260923 19:46:53.448803 2312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:53.452052 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:53.431921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:44159 (local address 127.0.0.1:45475)
0923 19:46:53.432116 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:53.432124 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:53.432707 (+ 583us) server_negotiation.cc:407] Connection header received
0923 19:46:53.432941 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:53.432944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:53.433003 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:53.433079 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:53.434786 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:53.435572 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:53.437540 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:53.438210 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:53.438308 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:53.442039 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:53.442046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:53.442053 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:53.442105 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:53.446647 (+ 4542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:53.447932 (+ 1285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:53.447940 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:53.447946 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:53.448141 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:53.448877 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:53.448885 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:53.448890 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:53.449427 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:53.449803 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:53.451272 (+ 1469us) server_negotiation.cc:299] Negotiation successful
0923 19:46:53.451520 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:46:53.454722 2315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:53.460292 2315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:53.471390 2315 catalog_manager.cc:1347] Generated new cluster ID: 6dd042fd3ac94387a0d8cf4bcbdd1020
I20260923 19:46:53.471539 2315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:53.494009 2315 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:53.495939 2315 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:53.508093 2315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 584157321d664f87a09d681323be9221: Generated new TSK 0
I20260923 19:46:53.509217 2315 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:53.517148 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2233
I20260923 19:46:53.519081 2295 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:53.611575 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2233
W20260923 19:46:53.629382 2218 connection.cc:535] client connection to 127.0.0.1:45475 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45475): Connection reset by peer (error 104)
2026-09-23T19:46:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2021 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:53 dist-test-slave-xg7f krb5kdc[2333](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:53 dist-test-slave-xg7f krb5kdc[2333](info): set up 2 sockets
Sep 23 19:46:53 dist-test-slave-xg7f krb5kdc[2333](info): commencing operation
krb5kdc: starting...
W20260923 19:46:54.711403 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:54 dist-test-slave-xg7f krb5kdc[2333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:54.958333 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41205
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:55.287724 2346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:55.288077 2346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:55.288259 2346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:55.295466 2346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:55.295629 2346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:55.295727 2346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:55.295822 2346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:55.295913 2346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:55.305534 2346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:55.306883 2346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:55.308261 2346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:55.320271 2351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:55.320369 2354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:55.320308 2352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:55.321113 2346 server_base.cc:1034] running on GCE node
I20260923 19:46:55.321955 2346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:55.323442 2346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:55.324668 2346 hybrid_clock.cc:648] HybridClock initialized: now 1790192815324628 us; error 32 us; skew 500 ppm
I20260923 19:46:55.325006 2346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:55 dist-test-slave-xg7f krb5kdc[2333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192815, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:55.328158 2346 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:55.329638 2346 webserver.cc:460] Webserver started at http://127.0.0.1:41637/ using document root <none> and password file <none>
I20260923 19:46:55.330425 2346 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:55.330585 2346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:55.330904 2346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:55.333994 2346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "7afca1f6811a4392afdfff47fd171f10"
format_stamp: "Formatted at 2026-09-23 19:46:55 on dist-test-slave-xg7f"
server_key: "83f85722202b0958ab77647f4e7a898b"
server_key_iv: "59c975af27a4070586c2b95633b0536b"
server_key_version: "encryptionkey@0"
I20260923 19:46:55.334817 2346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "7afca1f6811a4392afdfff47fd171f10"
format_stamp: "Formatted at 2026-09-23 19:46:55 on dist-test-slave-xg7f"
server_key: "83f85722202b0958ab77647f4e7a898b"
server_key_iv: "59c975af27a4070586c2b95633b0536b"
server_key_version: "encryptionkey@0"
I20260923 19:46:55.340170 2346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260923 19:46:55.343657 2361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:55.344991 2346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:46:55.345184 2346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "7afca1f6811a4392afdfff47fd171f10"
format_stamp: "Formatted at 2026-09-23 19:46:55 on dist-test-slave-xg7f"
server_key: "83f85722202b0958ab77647f4e7a898b"
server_key_iv: "59c975af27a4070586c2b95633b0536b"
server_key_version: "encryptionkey@0"
I20260923 19:46:55.345387 2346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:55.370719 2346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:55.374722 2346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:55.375015 2346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:55.393731 2346 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41205
I20260923 19:46:55.393754 2412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41205 every 8 connection(s)
I20260923 19:46:55.395112 2346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:55.398794 2413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:55.403277 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2346
I20260923 19:46:55.403455 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:55.403954 13667 external_mini_cluster.cc:1428] Setting key a9d27d080a012372815d4e556450a3a1
I20260923 19:46:55.410225 2413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10: Bootstrap starting.
I20260923 19:46:55.413882 2413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:55.415241 2413 log.cc:824] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:55.418084 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:55.405778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:39585 (local address 127.0.0.1:41205)
0923 19:46:55.406560 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:55.406571 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:55.406612 (+ 41us) server_negotiation.cc:407] Connection header received
0923 19:46:55.408711 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:55.408734 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:55.409132 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:55.409452 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:55.410049 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:55.411495 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:55.413362 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:55.414102 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:55.414228 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:55.415551 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:55.415558 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:55.415572 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:55.416357 (+ 785us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:55.416466 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:55.416502 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:55.416682 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:55.416962 (+ 280us) server_negotiation.cc:299] Negotiation successful
0923 19:46:55.417143 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":370,"threads_started":1}
I20260923 19:46:55.418341 2413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10: No bootstrap required, opened a new log
I20260923 19:46:55.421866 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:55.428346 2413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afca1f6811a4392afdfff47fd171f10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260923 19:46:55.428818 2413 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:55.428922 2413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7afca1f6811a4392afdfff47fd171f10, State: Initialized, Role: FOLLOWER
I20260923 19:46:55.429502 2413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afca1f6811a4392afdfff47fd171f10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260923 19:46:55.429785 2413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:55.429941 2413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:55.430115 2413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:55.433267 2413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afca1f6811a4392afdfff47fd171f10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260923 19:46:55.433864 2413 leader_election.cc:302] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7afca1f6811a4392afdfff47fd171f10; no voters:
I20260923 19:46:55.434031 2416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:55.427028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:48961 (local address 127.0.0.1:41205)
0923 19:46:55.427255 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:55.427262 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:55.427516 (+ 254us) server_negotiation.cc:407] Connection header received
0923 19:46:55.427720 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:55.427723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:55.427783 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:55.427860 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:55.428533 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:55.429522 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:55.431498 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:55.431967 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:55.432070 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:55.433222 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:55.433226 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:55.433229 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:55.433245 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:55.433299 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:55.433313 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:55.433393 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:55.433602 (+ 209us) server_negotiation.cc:299] Negotiation successful
0923 19:46:55.433641 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260923 19:46:55.434563 2413 leader_election.cc:288] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:55.434706 2423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:55.435959 2423 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [term 1 LEADER]: Becoming Leader. State: Replica: 7afca1f6811a4392afdfff47fd171f10, State: Running, Role: LEADER
I20260923 19:46:55.436517 2423 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afca1f6811a4392afdfff47fd171f10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260923 19:46:55.437053 2413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:55.439529 2424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7afca1f6811a4392afdfff47fd171f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afca1f6811a4392afdfff47fd171f10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } } }
I20260923 19:46:55.439617 2425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7afca1f6811a4392afdfff47fd171f10. Latest consensus state: current_term: 1 leader_uuid: "7afca1f6811a4392afdfff47fd171f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afca1f6811a4392afdfff47fd171f10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } } }
I20260923 19:46:55.439936 2424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:55.439996 2425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:55.441473 2429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:55.447988 2429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:55.459270 2429 catalog_manager.cc:1347] Generated new cluster ID: cad99f5f314c4225b774ef0da11c2150
I20260923 19:46:55.459388 2429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:55.473801 2429 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:55.475389 2429 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:55.481117 2429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7afca1f6811a4392afdfff47fd171f10: Generated new TSK 0
I20260923 19:46:55.481909 2429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:55.492482 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2346
W20260923 19:46:55.493716 2408 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.85:39585
W20260923 19:46:55.494542 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2346: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:46:55.494714 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2346
W20260923 19:46:55.512054 2331 connection.cc:535] client connection to 127.0.0.1:41205 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41205): Connection reset by peer (error 104)
2026-09-23T19:46:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1882 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:55 dist-test-slave-xg7f krb5kdc[2444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:55 dist-test-slave-xg7f krb5kdc[2444](info): set up 2 sockets
Sep 23 19:46:55 dist-test-slave-xg7f krb5kdc[2444](info): commencing operation
krb5kdc: starting...
W20260923 19:46:56.591552 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:56 dist-test-slave-xg7f krb5kdc[2444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:56.836306 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37281
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:57.160547 2457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:57.160852 2457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:57.160945 2457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:57.168066 2457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:57.168180 2457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:57.168226 2457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:57.168290 2457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:57.168331 2457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:57.178079 2457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:57.179340 2457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:57.180596 2457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:57.192166 2462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:57.192082 2465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:57.192123 2463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:57.192880 2457 server_base.cc:1034] running on GCE node
I20260923 19:46:57.193673 2457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:57.195051 2457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:57.196309 2457 hybrid_clock.cc:648] HybridClock initialized: now 1790192817196269 us; error 28 us; skew 500 ppm
I20260923 19:46:57.196662 2457 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:57 dist-test-slave-xg7f krb5kdc[2444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192817, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:57.205081 2457 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:57.206547 2457 webserver.cc:460] Webserver started at http://127.0.0.1:43829/ using document root <none> and password file <none>
I20260923 19:46:57.207288 2457 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:57.207405 2457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:57.207667 2457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:57.210618 2457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "b70b08d71e024071b7a70878365de046"
format_stamp: "Formatted at 2026-09-23 19:46:57 on dist-test-slave-xg7f"
server_key: "edb8029980d0f4f0e2c34db4385a60cc"
server_key_iv: "4ac6b65871fe2d815b7df03dc1530dc7"
server_key_version: "encryptionkey@0"
I20260923 19:46:57.211450 2457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "b70b08d71e024071b7a70878365de046"
format_stamp: "Formatted at 2026-09-23 19:46:57 on dist-test-slave-xg7f"
server_key: "edb8029980d0f4f0e2c34db4385a60cc"
server_key_iv: "4ac6b65871fe2d815b7df03dc1530dc7"
server_key_version: "encryptionkey@0"
I20260923 19:46:57.216454 2457 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:46:57.219827 2472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:57.221141 2457 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 19:46:57.221267 2457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "b70b08d71e024071b7a70878365de046"
format_stamp: "Formatted at 2026-09-23 19:46:57 on dist-test-slave-xg7f"
server_key: "edb8029980d0f4f0e2c34db4385a60cc"
server_key_iv: "4ac6b65871fe2d815b7df03dc1530dc7"
server_key_version: "encryptionkey@0"
I20260923 19:46:57.221412 2457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:57.227035 2457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:57.230926 2457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:57.231232 2457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:57.249076 2457 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37281
I20260923 19:46:57.249114 2523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37281 every 8 connection(s)
I20260923 19:46:57.250450 2457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:57.254073 2524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:46:57.260782 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2457
I20260923 19:46:57.261004 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:57.261511 13667 external_mini_cluster.cc:1428] Setting key c79228b3aafadedac8e9679e12704ae6
I20260923 19:46:57.264556 2524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046: Bootstrap starting.
I20260923 19:46:57.268026 2524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:57.269084 2524 log.cc:824] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:57.269125 2527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:57.263284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:34547 (local address 127.0.0.1:37281)
0923 19:46:57.264020 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:57.264032 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:57.264098 (+ 66us) server_negotiation.cc:407] Connection header received
0923 19:46:57.265797 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:57.265818 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:57.266196 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:57.266504 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:57.267603 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:57.267609 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:57.267621 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:57.267634 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:57.267686 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:57.267705 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:57.267835 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:57.268061 (+ 226us) server_negotiation.cc:299] Negotiation successful
0923 19:46:57.268263 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":324,"threads_started":1}
I20260923 19:46:57.272003 2524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046: No bootstrap required, opened a new log
I20260923 19:46:57.273002 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:57.279668 2527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:57.277069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:57947 (local address 127.0.0.1:37281)
0923 19:46:57.277246 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:57.277253 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:57.277722 (+ 469us) server_negotiation.cc:407] Connection header received
0923 19:46:57.277906 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:57.277911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:57.277968 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:57.278071 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:57.278968 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:57.278973 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:57.278978 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:46:57.278995 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:57.279045 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:46:57.279063 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:57.279255 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:57.279342 (+ 87us) server_negotiation.cc:299] Negotiation successful
0923 19:46:57.279399 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 19:46:57.280102 2524 raft_consensus.cc:348] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70b08d71e024071b7a70878365de046" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37281 } }
I20260923 19:46:57.280459 2524 raft_consensus.cc:374] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:57.280588 2524 raft_consensus.cc:729] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b70b08d71e024071b7a70878365de046, State: Initialized, Role: FOLLOWER
I20260923 19:46:57.281201 2524 consensus_queue.cc:260] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70b08d71e024071b7a70878365de046" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37281 } }
I20260923 19:46:57.281505 2524 raft_consensus.cc:388] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:57.281607 2524 raft_consensus.cc:482] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:57.281751 2524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:57.283805 2524 raft_consensus.cc:504] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70b08d71e024071b7a70878365de046" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37281 } }
I20260923 19:46:57.284277 2524 leader_election.cc:302] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b70b08d71e024071b7a70878365de046; no voters:
I20260923 19:46:57.284770 2524 leader_election.cc:288] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:57.284888 2534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:57.286568 2534 raft_consensus.cc:686] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [term 1 LEADER]: Becoming Leader. State: Replica: b70b08d71e024071b7a70878365de046, State: Running, Role: LEADER
I20260923 19:46:57.287147 2534 consensus_queue.cc:237] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70b08d71e024071b7a70878365de046" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37281 } }
I20260923 19:46:57.288069 2524 sys_catalog.cc:564] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:57.290271 2536 sys_catalog.cc:455] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b70b08d71e024071b7a70878365de046. Latest consensus state: current_term: 1 leader_uuid: "b70b08d71e024071b7a70878365de046" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70b08d71e024071b7a70878365de046" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37281 } } }
I20260923 19:46:57.290238 2535 sys_catalog.cc:455] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b70b08d71e024071b7a70878365de046" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b70b08d71e024071b7a70878365de046" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37281 } } }
I20260923 19:46:57.290756 2535 sys_catalog.cc:458] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:57.290757 2536 sys_catalog.cc:458] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:57.297161 2540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:57.301693 2540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:57.309985 2540 catalog_manager.cc:1347] Generated new cluster ID: 777b829022524dffadd5f06a5a772ccf
I20260923 19:46:57.310115 2540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:57.322731 2540 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:57.323243 2540 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:57.332115 2540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b70b08d71e024071b7a70878365de046: Generated new TSK 0
I20260923 19:46:57.332953 2540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:57.348798 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2457
W20260923 19:46:57.349959 2519 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.85:34547
W20260923 19:46:57.350677 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2457: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:46:57.350827 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2457
2026-09-23T19:46:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1852 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:57 dist-test-slave-xg7f krb5kdc[2555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:57 dist-test-slave-xg7f krb5kdc[2555](info): set up 2 sockets
Sep 23 19:46:57 dist-test-slave-xg7f krb5kdc[2555](info): commencing operation
krb5kdc: starting...
W20260923 19:46:58.439636 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.001s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:46:58 dist-test-slave-xg7f krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:46:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:46:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:46:58.684077 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44207
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44207
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:46:59.011415 2568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:46:59.011734 2568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:46:59.011902 2568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:46:59.019136 2568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:46:59.019248 2568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:46:59.019361 2568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:46:59.019464 2568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:46:59.019548 2568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:46:59.029482 2568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44207
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:46:59.030876 2568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:46:59.032287 2568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:46:59.043898 2573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:59.043998 2576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:46:59.043998 2574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:46:59.044986 2568 server_base.cc:1034] running on GCE node
I20260923 19:46:59.045714 2568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:46:59.047191 2568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:46:59.048421 2568 hybrid_clock.cc:648] HybridClock initialized: now 1790192819048375 us; error 55 us; skew 500 ppm
I20260923 19:46:59.048750 2568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:46:59 dist-test-slave-xg7f krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192819, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:46:59.051883 2568 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:46:59.053229 2568 webserver.cc:460] Webserver started at http://127.0.0.1:39405/ using document root <none> and password file <none>
I20260923 19:46:59.053893 2568 fs_manager.cc:359] Metadata directory not provided
I20260923 19:46:59.054032 2568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:46:59.054327 2568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:46:59.057199 2568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "4fe7ba81320f4117804667daf3362c02"
format_stamp: "Formatted at 2026-09-23 19:46:59 on dist-test-slave-xg7f"
server_key: "e00d2cc59025622c809ebf370b75c7c3"
server_key_iv: "a2f75bc945275733a34d4d7d4608ba79"
server_key_version: "encryptionkey@0"
I20260923 19:46:59.057940 2568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "4fe7ba81320f4117804667daf3362c02"
format_stamp: "Formatted at 2026-09-23 19:46:59 on dist-test-slave-xg7f"
server_key: "e00d2cc59025622c809ebf370b75c7c3"
server_key_iv: "a2f75bc945275733a34d4d7d4608ba79"
server_key_version: "encryptionkey@0"
I20260923 19:46:59.062726 2568 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260923 19:46:59.066008 2583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:46:59.067374 2568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:46:59.067551 2568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "4fe7ba81320f4117804667daf3362c02"
format_stamp: "Formatted at 2026-09-23 19:46:59 on dist-test-slave-xg7f"
server_key: "e00d2cc59025622c809ebf370b75c7c3"
server_key_iv: "a2f75bc945275733a34d4d7d4608ba79"
server_key_version: "encryptionkey@0"
I20260923 19:46:59.067742 2568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:46:59.095496 2568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:46:59.099939 2568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:46:59.100235 2568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:46:59.118170 2568 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44207
I20260923 19:46:59.118192 2634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44207 every 8 connection(s)
I20260923 19:46:59.119601 2568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:46:59.121302 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2568
I20260923 19:46:59.121474 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:46:59.121915 13667 external_mini_cluster.cc:1428] Setting key ca2706efba0f4806aab4951d215fede9
I20260923 19:46:59.123530 2635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:46:59 dist-test-slave-xg7f krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 19:46:59.137777 2635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02: Bootstrap starting.
I20260923 19:46:59.141166 2635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02: Neither blocks nor log segments found. Creating new log.
I20260923 19:46:59.142216 2635 log.cc:824] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02: Log is configured to *not* fsync() on all Append() calls
I20260923 19:46:59.145279 2638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:59.123678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:44497 (local address 127.0.0.1:44207)
0923 19:46:59.124395 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:59.124406 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:59.124446 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:46:59.126210 (+ 1764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:59.126235 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:59.126828 (+ 593us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:59.127306 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:59.129165 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:59.130496 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:59.132326 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:59.132962 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:59.133087 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:59.137786 (+ 4699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:59.137794 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:59.137808 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:59.137843 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:59.141002 (+ 3159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:59.141817 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:59.141823 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:59.141830 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:59.141996 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:59.142470 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:59.142474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:59.142476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:59.143254 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:59.143608 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:59.143976 (+ 368us) server_negotiation.cc:299] Negotiation successful
0923 19:46:59.144296 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":299,"threads_started":1}
I20260923 19:46:59.145319 2635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02: No bootstrap required, opened a new log
I20260923 19:46:59.149065 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:46:59.155089 2635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe7ba81320f4117804667daf3362c02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44207 } }
I20260923 19:46:59.155537 2635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:46:59.155637 2635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe7ba81320f4117804667daf3362c02, State: Initialized, Role: FOLLOWER
I20260923 19:46:59.156261 2635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe7ba81320f4117804667daf3362c02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44207 } }
I20260923 19:46:59.156481 2635 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:46:59.156692 2635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:46:59.156926 2635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:46:59.159633 2635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe7ba81320f4117804667daf3362c02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44207 } }
I20260923 19:46:59.160264 2635 leader_election.cc:302] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe7ba81320f4117804667daf3362c02; no voters:
I20260923 19:46:59.160977 2635 leader_election.cc:288] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:46:59.161147 2645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:46:59.163051 2635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:46:59.163687 2645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [term 1 LEADER]: Becoming Leader. State: Replica: 4fe7ba81320f4117804667daf3362c02, State: Running, Role: LEADER
I20260923 19:46:59.164330 2645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe7ba81320f4117804667daf3362c02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44207 } }
I20260923 19:46:59.168565 2647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe7ba81320f4117804667daf3362c02. Latest consensus state: current_term: 1 leader_uuid: "4fe7ba81320f4117804667daf3362c02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe7ba81320f4117804667daf3362c02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44207 } } }
I20260923 19:46:59.168459 2646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fe7ba81320f4117804667daf3362c02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe7ba81320f4117804667daf3362c02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44207 } } }
I20260923 19:46:59.168874 2646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:59.168874 2647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02 [sys.catalog]: This master's current role is: LEADER
I20260923 19:46:59.174110 2638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:46:59.154238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:39263 (local address 127.0.0.1:44207)
0923 19:46:59.154405 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:46:59.154411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:46:59.154739 (+ 328us) server_negotiation.cc:407] Connection header received
0923 19:46:59.154880 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:46:59.154885 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:46:59.154961 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:46:59.155076 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:46:59.156722 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:59.157888 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:59.159175 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:46:59.159884 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:46:59.160004 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:46:59.163433 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:46:59.163440 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:46:59.163445 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:46:59.163510 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:46:59.168252 (+ 4742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:59.169496 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:59.169505 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:59.169511 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:59.169742 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:46:59.170448 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:46:59.170456 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:46:59.170462 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:46:59.171037 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:46:59.171450 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0923 19:46:59.173277 (+ 1827us) server_negotiation.cc:299] Negotiation successful
0923 19:46:59.173517 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:46:59.180190 2653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:46:59.185242 2653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:46:59.193781 2653 catalog_manager.cc:1347] Generated new cluster ID: e4e9cafc78db41f8a62fec8826a5a7d1
I20260923 19:46:59.193893 2653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:46:59.219547 2653 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:46:59.220863 2653 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:46:59.228297 2653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fe7ba81320f4117804667daf3362c02: Generated new TSK 0
I20260923 19:46:59.229157 2653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:46:59.237740 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2568
I20260923 19:46:59.239030 2630 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:46:59.330973 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2568
W20260923 19:46:59.348099 2553 connection.cc:535] client connection to 127.0.0.1:44207 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44207): Connection reset by peer (error 104)
2026-09-23T19:46:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1983 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:46:59 dist-test-slave-xg7f krb5kdc[2667](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:46:59 dist-test-slave-xg7f krb5kdc[2667](info): set up 2 sockets
Sep 23 19:46:59 dist-test-slave-xg7f krb5kdc[2667](info): commencing operation
krb5kdc: starting...
W20260923 19:47:00.411629 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:00 dist-test-slave-xg7f krb5kdc[2667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:47:00.688134 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37523
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:01.016860 2680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:01.017220 2680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:01.017376 2680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:01.024751 2680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:01.024919 2680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:01.025022 2680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:01.025135 2680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:01.025210 2680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:01.035228 2680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37523
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:01.036593 2680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:01.037941 2680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:01.049782 2685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:01.049713 2686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:01.049798 2688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:01.050370 2680 server_base.cc:1034] running on GCE node
I20260923 19:47:01.051229 2680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:01.052631 2680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:01.053853 2680 hybrid_clock.cc:648] HybridClock initialized: now 1790192821053813 us; error 35 us; skew 500 ppm
I20260923 19:47:01.054194 2680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:01 dist-test-slave-xg7f krb5kdc[2667](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192821, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:01.057219 2680 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:47:01.058636 2680 webserver.cc:460] Webserver started at http://127.0.0.1:45797/ using document root <none> and password file <none>
I20260923 19:47:01.059410 2680 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:01.059582 2680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:01.059880 2680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:01.062749 2680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "4179d3e8934d4923ac3108b8b58e3a46"
format_stamp: "Formatted at 2026-09-23 19:47:01 on dist-test-slave-xg7f"
server_key: "8616b9f8c0a4071d5a3ddd6cb327c30b"
server_key_iv: "87b989233be04303fc7d0e3e66dcbb09"
server_key_version: "encryptionkey@0"
I20260923 19:47:01.063500 2680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "4179d3e8934d4923ac3108b8b58e3a46"
format_stamp: "Formatted at 2026-09-23 19:47:01 on dist-test-slave-xg7f"
server_key: "8616b9f8c0a4071d5a3ddd6cb327c30b"
server_key_iv: "87b989233be04303fc7d0e3e66dcbb09"
server_key_version: "encryptionkey@0"
I20260923 19:47:01.068444 2680 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:47:01.071750 2695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:01.073040 2680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260923 19:47:01.073212 2680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "4179d3e8934d4923ac3108b8b58e3a46"
format_stamp: "Formatted at 2026-09-23 19:47:01 on dist-test-slave-xg7f"
server_key: "8616b9f8c0a4071d5a3ddd6cb327c30b"
server_key_iv: "87b989233be04303fc7d0e3e66dcbb09"
server_key_version: "encryptionkey@0"
I20260923 19:47:01.073396 2680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:01.090092 2680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:01.094153 2680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:01.094465 2680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:01.113356 2680 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37523
I20260923 19:47:01.113415 2746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37523 every 8 connection(s)
I20260923 19:47:01.114755 2680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:01.118371 2747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:01.123286 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2680
I20260923 19:47:01.123472 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:01.124012 13667 external_mini_cluster.cc:1428] Setting key ac3c93d2ea8e2d377017f746990de921
I20260923 19:47:01.130425 2747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46: Bootstrap starting.
I20260923 19:47:01.134464 2747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:01.135855 2747 log.cc:824] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:01.139317 2747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46: No bootstrap required, opened a new log
I20260923 19:47:01.141743 2750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:01.126145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:57309 (local address 127.0.0.1:37523)
0923 19:47:01.127271 (+ 1126us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:01.127287 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:01.127638 (+ 351us) server_negotiation.cc:407] Connection header received
0923 19:47:01.130097 (+ 2459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:01.130125 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:01.130682 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:01.131150 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:01.131637 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:01.133669 (+ 2032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:01.135749 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:01.137010 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:01.137211 (+ 201us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:01.138877 (+ 1666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:01.138887 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:01.138906 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:01.139665 (+ 759us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:01.139773 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:01.139815 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:01.139997 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:01.140269 (+ 272us) server_negotiation.cc:299] Negotiation successful
0923 19:47:01.140446 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":491,"threads_started":1}
I20260923 19:47:01.145860 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:01.149217 2747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4179d3e8934d4923ac3108b8b58e3a46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37523 } }
I20260923 19:47:01.149768 2747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:01.149896 2747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4179d3e8934d4923ac3108b8b58e3a46, State: Initialized, Role: FOLLOWER
I20260923 19:47:01.150648 2747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4179d3e8934d4923ac3108b8b58e3a46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37523 } }
I20260923 19:47:01.150954 2747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:01.151177 2747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:01.151402 2747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:01.154492 2747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4179d3e8934d4923ac3108b8b58e3a46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37523 } }
I20260923 19:47:01.154973 2747 leader_election.cc:302] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4179d3e8934d4923ac3108b8b58e3a46; no voters:
I20260923 19:47:01.155643 2747 leader_election.cc:288] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:01.155756 2757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:01.157119 2757 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [term 1 LEADER]: Becoming Leader. State: Replica: 4179d3e8934d4923ac3108b8b58e3a46, State: Running, Role: LEADER
I20260923 19:47:01.157624 2757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4179d3e8934d4923ac3108b8b58e3a46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37523 } }
I20260923 19:47:01.157989 2747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:01.158843 2750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:01.151428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:44415 (local address 127.0.0.1:37523)
0923 19:47:01.151658 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:01.151665 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:01.152069 (+ 404us) server_negotiation.cc:407] Connection header received
0923 19:47:01.152217 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:01.152225 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:01.152312 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:01.152444 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:01.152902 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:01.154002 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:01.155501 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:01.156291 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:01.157676 (+ 1385us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:01.157920 (+ 244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:01.157925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:01.157929 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:01.157949 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:01.158017 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:01.158039 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:01.158245 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:01.158465 (+ 220us) server_negotiation.cc:299] Negotiation successful
0923 19:47:01.158528 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260923 19:47:01.166817 2758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4179d3e8934d4923ac3108b8b58e3a46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4179d3e8934d4923ac3108b8b58e3a46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37523 } } }
I20260923 19:47:01.167315 2758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:01.167205 2759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4179d3e8934d4923ac3108b8b58e3a46. Latest consensus state: current_term: 1 leader_uuid: "4179d3e8934d4923ac3108b8b58e3a46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4179d3e8934d4923ac3108b8b58e3a46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37523 } } }
I20260923 19:47:01.167512 2759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:01.169291 2767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:01.174291 2767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:01.183465 2767 catalog_manager.cc:1347] Generated new cluster ID: 7e19560c13a64b0c84e622492c981ad9
I20260923 19:47:01.183599 2767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:01.192902 2767 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:01.194782 2767 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:01.203965 2767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4179d3e8934d4923ac3108b8b58e3a46: Generated new TSK 0
I20260923 19:47:01.204900 2767 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:01.218102 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2680
W20260923 19:47:01.219434 2742 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.85:57309
W20260923 19:47:01.220212 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2680: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:47:01.220368 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2680
W20260923 19:47:01.237483 2665 connection.cc:535] client connection to 127.0.0.1:37523 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37523): Connection reset by peer (error 104)
2026-09-23T19:47:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1889 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:01 dist-test-slave-xg7f krb5kdc[2778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:01 dist-test-slave-xg7f krb5kdc[2778](info): set up 2 sockets
Sep 23 19:47:01 dist-test-slave-xg7f krb5kdc[2778](info): commencing operation
krb5kdc: starting...
W20260923 19:47:02.319722 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:02 dist-test-slave-xg7f krb5kdc[2778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 19:47:02.563686 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39919
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:02.886981 2791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:02.887323 2791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:02.887465 2791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:02.894358 2791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:02.894451 2791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:02.894548 2791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:02.894652 2791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:02.894740 2791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:02.904685 2791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39919
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:02.906046 2791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:02.907373 2791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:02.919592 2796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:02.919760 2799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:02.919749 2797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:02.920665 2791 server_base.cc:1034] running on GCE node
I20260923 19:47:02.921416 2791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:02.922757 2791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:02.923982 2791 hybrid_clock.cc:648] HybridClock initialized: now 1790192822923946 us; error 49 us; skew 500 ppm
I20260923 19:47:02.924333 2791 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:02 dist-test-slave-xg7f krb5kdc[2778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192822, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:02.932327 2791 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 19:47:02.933805 2791 webserver.cc:460] Webserver started at http://127.0.0.1:35485/ using document root <none> and password file <none>
I20260923 19:47:02.934480 2791 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:02.934615 2791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:02.934909 2791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:02.937899 2791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "4afa074972aa40b3b12950f48a72a93e"
format_stamp: "Formatted at 2026-09-23 19:47:02 on dist-test-slave-xg7f"
server_key: "07a1fe277680968f35e6ba704b033ad2"
server_key_iv: "04c93dc4bd513c93cf6fcec41969ed25"
server_key_version: "encryptionkey@0"
I20260923 19:47:02.938638 2791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "4afa074972aa40b3b12950f48a72a93e"
format_stamp: "Formatted at 2026-09-23 19:47:02 on dist-test-slave-xg7f"
server_key: "07a1fe277680968f35e6ba704b033ad2"
server_key_iv: "04c93dc4bd513c93cf6fcec41969ed25"
server_key_version: "encryptionkey@0"
I20260923 19:47:02.943665 2791 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260923 19:47:02.946947 2806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:02.948302 2791 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:47:02.948477 2791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "4afa074972aa40b3b12950f48a72a93e"
format_stamp: "Formatted at 2026-09-23 19:47:02 on dist-test-slave-xg7f"
server_key: "07a1fe277680968f35e6ba704b033ad2"
server_key_iv: "04c93dc4bd513c93cf6fcec41969ed25"
server_key_version: "encryptionkey@0"
I20260923 19:47:02.948665 2791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:02.954396 2791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:02.958333 2791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:02.958633 2791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:02.977074 2791 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39919
I20260923 19:47:02.977177 2857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39919 every 8 connection(s)
I20260923 19:47:02.978505 2791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:02.982105 2858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:02.987461 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2791
I20260923 19:47:02.987640 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:02.988055 13667 external_mini_cluster.cc:1428] Setting key 2d8bd40d5caabca51fcc905a612910f8
I20260923 19:47:02.992825 2858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e: Bootstrap starting.
I20260923 19:47:02.995779 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:02.989878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:49663 (local address 127.0.0.1:39919)
0923 19:47:02.990698 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:02.990709 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:02.990751 (+ 42us) server_negotiation.cc:407] Connection header received
0923 19:47:02.992411 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:02.992434 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:02.992779 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:02.993170 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:02.994169 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:02.994174 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:02.994190 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:02.994204 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:02.994262 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:02.994284 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:02.994531 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:02.994676 (+ 145us) server_negotiation.cc:299] Negotiation successful
0923 19:47:02.994853 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":391,"threads_started":1}
I20260923 19:47:02.996179 2858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:02.997396 2858 log.cc:824] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:02.999696 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:03.000479 2858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e: No bootstrap required, opened a new log
I20260923 19:47:03.006419 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:03.004028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.85:37173 (local address 127.0.0.1:39919)
0923 19:47:03.004213 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:03.004219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:03.004595 (+ 376us) server_negotiation.cc:407] Connection header received
0923 19:47:03.004718 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:03.004723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:03.004784 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:03.004889 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:03.005793 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:03.005799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:03.005805 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:03.005822 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:03.005878 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:03.005896 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:03.006023 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:03.006067 (+ 44us) server_negotiation.cc:299] Negotiation successful
0923 19:47:03.006128 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 19:47:03.008786 2858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4afa074972aa40b3b12950f48a72a93e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39919 } }
I20260923 19:47:03.009140 2858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:03.009251 2858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4afa074972aa40b3b12950f48a72a93e, State: Initialized, Role: FOLLOWER
I20260923 19:47:03.009869 2858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4afa074972aa40b3b12950f48a72a93e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39919 } }
I20260923 19:47:03.010118 2858 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:03.010263 2858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:03.010437 2858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:03.012676 2858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4afa074972aa40b3b12950f48a72a93e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39919 } }
I20260923 19:47:03.013178 2858 leader_election.cc:302] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4afa074972aa40b3b12950f48a72a93e; no voters:
I20260923 19:47:03.013828 2858 leader_election.cc:288] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:03.013931 2868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:03.014704 2868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [term 1 LEADER]: Becoming Leader. State: Replica: 4afa074972aa40b3b12950f48a72a93e, State: Running, Role: LEADER
I20260923 19:47:03.015269 2868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4afa074972aa40b3b12950f48a72a93e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39919 } }
I20260923 19:47:03.016001 2858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:03.018481 2870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4afa074972aa40b3b12950f48a72a93e. Latest consensus state: current_term: 1 leader_uuid: "4afa074972aa40b3b12950f48a72a93e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4afa074972aa40b3b12950f48a72a93e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39919 } } }
I20260923 19:47:03.018962 2870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:03.018770 2869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4afa074972aa40b3b12950f48a72a93e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4afa074972aa40b3b12950f48a72a93e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39919 } } }
I20260923 19:47:03.019069 2869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:03.024201 2875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:03.029526 2875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:03.038017 2875 catalog_manager.cc:1347] Generated new cluster ID: 94984de6d2dd4c6baa1f18aacbb4b31b
I20260923 19:47:03.038134 2875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:03.068609 2875 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:03.069088 2875 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:03.079236 2875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4afa074972aa40b3b12950f48a72a93e: Generated new TSK 0
I20260923 19:47:03.080288 2875 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:03.092270 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2791
W20260923 19:47:03.093328 2853 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.85:49663
W20260923 19:47:03.093999 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2791: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:47:03.094127 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2791
2026-09-23T19:47:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1873 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:03 dist-test-slave-xg7f krb5kdc[2889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:03 dist-test-slave-xg7f krb5kdc[2889](info): set up 2 sockets
Sep 23 19:47:03 dist-test-slave-xg7f krb5kdc[2889](info): commencing operation
krb5kdc: starting...
W20260923 19:47:04.175436 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.002s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:04 dist-test-slave-xg7f krb5kdc[2889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:04.413945 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:46651
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:44551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:46651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:04.729246 2902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:04.729616 2902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:04.729785 2902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:04.736963 2902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:04.737125 2902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:04.737236 2902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:04.737346 2902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:04.737432 2902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:04.747152 2902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:44551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:46651
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:46651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:04.748538 2902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:04.749878 2902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:04.761976 2907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:04.762004 2908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:04.762101 2910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:04.762725 2902 server_base.cc:1034] running on GCE node
I20260923 19:47:04.763597 2902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:04.765079 2902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:04.766281 2902 hybrid_clock.cc:648] HybridClock initialized: now 1790192824766230 us; error 37 us; skew 500 ppm
I20260923 19:47:04.766629 2902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:04 dist-test-slave-xg7f krb5kdc[2889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192824, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:04.769665 2902 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:04.771358 2902 webserver.cc:460] Webserver started at http://127.13.88.254:40311/ using document root <none> and password file <none>
I20260923 19:47:04.772048 2902 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:04.772176 2902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:04.772487 2902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:04.775539 2902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "7f46c6ab0a6740f4a99b41516bf65663"
format_stamp: "Formatted at 2026-09-23 19:47:04 on dist-test-slave-xg7f"
server_key: "e90a60b17924822fdda7b6c046b931fa"
server_key_iv: "00f98fff7eed9f1383876eca8723fa9e"
server_key_version: "encryptionkey@0"
I20260923 19:47:04.776317 2902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "7f46c6ab0a6740f4a99b41516bf65663"
format_stamp: "Formatted at 2026-09-23 19:47:04 on dist-test-slave-xg7f"
server_key: "e90a60b17924822fdda7b6c046b931fa"
server_key_iv: "00f98fff7eed9f1383876eca8723fa9e"
server_key_version: "encryptionkey@0"
I20260923 19:47:04.781335 2902 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260923 19:47:04.784636 2917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:04.785951 2902 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:47:04.786130 2902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "7f46c6ab0a6740f4a99b41516bf65663"
format_stamp: "Formatted at 2026-09-23 19:47:04 on dist-test-slave-xg7f"
server_key: "e90a60b17924822fdda7b6c046b931fa"
server_key_iv: "00f98fff7eed9f1383876eca8723fa9e"
server_key_version: "encryptionkey@0"
I20260923 19:47:04.786319 2902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:04.802114 2902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:04.806372 2902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:04.806658 2902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:04.825034 2902 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:46651
I20260923 19:47:04.825053 2968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:46651 every 8 connection(s)
I20260923 19:47:04.826427 2902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:04.830142 2969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:04.836058 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 2902
I20260923 19:47:04.836257 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:04.836781 13667 external_mini_cluster.cc:1428] Setting key c3204a9b530ea805f78d9cea6c931bd0
I20260923 19:47:04.841082 2969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663: Bootstrap starting.
I20260923 19:47:04.844623 2969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:04.845873 2969 log.cc:824] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:04.848995 2969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663: No bootstrap required, opened a new log
Sep 23 19:47:04 dist-test-slave-xg7f krb5kdc[2889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:47:04.857107 2969 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f46c6ab0a6740f4a99b41516bf65663" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46651 } }
I20260923 19:47:04.857467 2969 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:04.857585 2969 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f46c6ab0a6740f4a99b41516bf65663, State: Initialized, Role: FOLLOWER
I20260923 19:47:04.858258 2969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f46c6ab0a6740f4a99b41516bf65663" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46651 } }
I20260923 19:47:04.858529 2969 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:04.858690 2969 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:04.858875 2969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:04.859936 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:04.838547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53497 (local address 127.13.88.254:46651)
0923 19:47:04.839407 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:04.839417 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:04.839457 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:47:04.841030 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:04.841051 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:04.841474 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:04.841786 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:04.843612 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:04.844913 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:04.846698 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:04.847560 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:04.847692 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:04.852425 (+ 4733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:04.852432 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:04.852449 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:04.852489 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:04.855602 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:04.856389 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:04.856395 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:04.856405 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:04.856574 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:04.857017 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:04.857027 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:04.857030 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:04.857592 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:04.857950 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:04.858482 (+ 532us) server_negotiation.cc:299] Negotiation successful
0923 19:47:04.858775 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":433,"threads_started":1}
I20260923 19:47:04.861337 2969 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f46c6ab0a6740f4a99b41516bf65663" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46651 } }
I20260923 19:47:04.861865 2969 leader_election.cc:302] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f46c6ab0a6740f4a99b41516bf65663; no voters:
I20260923 19:47:04.862527 2969 leader_election.cc:288] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:04.862627 2974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:04.863749 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:04.863823 2974 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [term 1 LEADER]: Becoming Leader. State: Replica: 7f46c6ab0a6740f4a99b41516bf65663, State: Running, Role: LEADER
I20260923 19:47:04.864357 2974 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f46c6ab0a6740f4a99b41516bf65663" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46651 } }
I20260923 19:47:04.864774 2969 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:04.867264 2975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f46c6ab0a6740f4a99b41516bf65663" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f46c6ab0a6740f4a99b41516bf65663" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46651 } } }
I20260923 19:47:04.867673 2975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:04.870196 2976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f46c6ab0a6740f4a99b41516bf65663. Latest consensus state: current_term: 1 leader_uuid: "7f46c6ab0a6740f4a99b41516bf65663" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f46c6ab0a6740f4a99b41516bf65663" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 46651 } } }
I20260923 19:47:04.870551 2976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:04.872603 2980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:04.879490 2980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:04.892303 2980 catalog_manager.cc:1347] Generated new cluster ID: fdaa534b0ac541cdb5db79f72141bc3e
I20260923 19:47:04.892457 2980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:04.897051 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:04.874702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37399 (local address 127.13.88.254:46651)
0923 19:47:04.874901 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:04.874909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:04.879725 (+ 4816us) server_negotiation.cc:407] Connection header received
0923 19:47:04.880021 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:04.880027 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:04.880102 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:04.880171 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:04.882265 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:04.883515 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:04.885393 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:04.886070 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:04.886181 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:04.889642 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:04.889649 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:04.889655 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:04.889706 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:04.893351 (+ 3645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:04.894216 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:04.894221 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:04.894225 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:04.894394 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:04.895051 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:04.895056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:04.895058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:04.895549 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:04.895813 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:04.896507 (+ 694us) server_negotiation.cc:299] Negotiation successful
0923 19:47:04.896691 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:47:04.901767 2997 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:47:04.914409 2980 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:04.916222 2980 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:04.936282 2980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f46c6ab0a6740f4a99b41516bf65663: Generated new TSK 0
I20260923 19:47:04.937319 2980 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:04.943395 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 2902
I20260923 19:47:04.944449 2964 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:05.034718 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 2902
W20260923 19:47:05.051533 2887 connection.cc:535] client connection to 127.13.88.254:46651 recv error: Network error: failed to read from TLS socket (remote: 127.13.88.254:46651): Connection reset by peer (error 104)
2026-09-23T19:47:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1940 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:05 dist-test-slave-xg7f krb5kdc[3001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:05 dist-test-slave-xg7f krb5kdc[3001](info): set up 2 sockets
Sep 23 19:47:05 dist-test-slave-xg7f krb5kdc[3001](info): commencing operation
krb5kdc: starting...
W20260923 19:47:06.119488 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:06 dist-test-slave-xg7f krb5kdc[3001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:06.354727 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:37049
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:40017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:37049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:06.679791 3014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:06.680078 3014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:06.680171 3014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:06.687155 3014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:06.687245 3014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:06.687289 3014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:06.687350 3014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:06.687390 3014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:06.696714 3014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:40017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:37049
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:37049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:06.697878 3014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:06.699074 3014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:06.710688 3019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:06.710769 3020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:06.710844 3022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:06.711833 3014 server_base.cc:1034] running on GCE node
I20260923 19:47:06.712615 3014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:06.713908 3014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:06.715174 3014 hybrid_clock.cc:648] HybridClock initialized: now 1790192826715130 us; error 51 us; skew 500 ppm
I20260923 19:47:06.715530 3014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:06 dist-test-slave-xg7f krb5kdc[3001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192826, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:06.718451 3014 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:06.719844 3014 webserver.cc:460] Webserver started at http://127.13.88.254:44453/ using document root <none> and password file <none>
I20260923 19:47:06.720492 3014 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:06.720645 3014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:06.720939 3014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:06.723901 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "546d025cdba842589028f875c22cc9f7"
format_stamp: "Formatted at 2026-09-23 19:47:06 on dist-test-slave-xg7f"
server_key: "5ff3a144878753d44294b876d936c837"
server_key_iv: "754923e7825241f16e8c95f5d2b29160"
server_key_version: "encryptionkey@0"
I20260923 19:47:06.724611 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "546d025cdba842589028f875c22cc9f7"
format_stamp: "Formatted at 2026-09-23 19:47:06 on dist-test-slave-xg7f"
server_key: "5ff3a144878753d44294b876d936c837"
server_key_iv: "754923e7825241f16e8c95f5d2b29160"
server_key_version: "encryptionkey@0"
I20260923 19:47:06.729455 3014 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 19:47:06.732779 3029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:06.733971 3014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 19:47:06.734145 3014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "546d025cdba842589028f875c22cc9f7"
format_stamp: "Formatted at 2026-09-23 19:47:06 on dist-test-slave-xg7f"
server_key: "5ff3a144878753d44294b876d936c837"
server_key_iv: "754923e7825241f16e8c95f5d2b29160"
server_key_version: "encryptionkey@0"
I20260923 19:47:06.734346 3014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:06.767140 3014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:06.771073 3014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:06.771390 3014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:06.789031 3014 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:37049
I20260923 19:47:06.789050 3080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:37049 every 8 connection(s)
I20260923 19:47:06.790330 3014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:06.793895 3081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:06.798418 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3014
I20260923 19:47:06.798609 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:06.799086 13667 external_mini_cluster.cc:1428] Setting key 75d98b6eadad79fe68be925cf31ce21d
I20260923 19:47:06.804628 3081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7: Bootstrap starting.
I20260923 19:47:06.808142 3081 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:06.809422 3081 log.cc:824] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:06.812340 3084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:06.800799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46907 (local address 127.13.88.254:37049)
0923 19:47:06.801548 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:06.801559 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:06.801599 (+ 40us) server_negotiation.cc:407] Connection header received
0923 19:47:06.803326 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:06.803347 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:06.803727 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:06.804017 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:06.804620 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:06.805931 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:06.807800 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:06.808516 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:06.808650 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:06.809865 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:06.809872 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:06.809885 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:06.810672 (+ 787us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:06.810758 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:06.810795 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:06.810914 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:06.811261 (+ 347us) server_negotiation.cc:299] Negotiation successful
0923 19:47:06.811438 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":363,"threads_started":1}
I20260923 19:47:06.812430 3081 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7: No bootstrap required, opened a new log
I20260923 19:47:06.815941 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:06.822362 3081 raft_consensus.cc:348] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546d025cdba842589028f875c22cc9f7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37049 } }
I20260923 19:47:06.822870 3081 raft_consensus.cc:374] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:06.822988 3081 raft_consensus.cc:729] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546d025cdba842589028f875c22cc9f7, State: Initialized, Role: FOLLOWER
I20260923 19:47:06.823649 3081 consensus_queue.cc:260] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546d025cdba842589028f875c22cc9f7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37049 } }
I20260923 19:47:06.823894 3081 raft_consensus.cc:388] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:06.824055 3081 raft_consensus.cc:482] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:06.824261 3081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:06.827318 3081 raft_consensus.cc:504] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546d025cdba842589028f875c22cc9f7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37049 } }
I20260923 19:47:06.827877 3081 leader_election.cc:302] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 546d025cdba842589028f875c22cc9f7; no voters:
I20260923 19:47:06.828601 3084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:06.821763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48853 (local address 127.13.88.254:37049)
0923 19:47:06.821970 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:06.821976 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:06.822309 (+ 333us) server_negotiation.cc:407] Connection header received
0923 19:47:06.822515 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:06.822519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:06.822574 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:06.822646 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:06.823291 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:06.824285 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:06.826129 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:06.826550 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:06.826636 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:06.827782 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:06.827786 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:06.827789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:06.827804 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:06.827835 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:06.827848 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:06.827962 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:06.828168 (+ 206us) server_negotiation.cc:299] Negotiation successful
0923 19:47:06.828240 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:47:06.828640 3081 leader_election.cc:288] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:06.828747 3091 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:06.830236 3091 raft_consensus.cc:686] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [term 1 LEADER]: Becoming Leader. State: Replica: 546d025cdba842589028f875c22cc9f7, State: Running, Role: LEADER
I20260923 19:47:06.830873 3091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546d025cdba842589028f875c22cc9f7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37049 } }
I20260923 19:47:06.831074 3081 sys_catalog.cc:564] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:06.833772 3093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 546d025cdba842589028f875c22cc9f7. Latest consensus state: current_term: 1 leader_uuid: "546d025cdba842589028f875c22cc9f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546d025cdba842589028f875c22cc9f7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37049 } } }
I20260923 19:47:06.834318 3093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:06.833945 3092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "546d025cdba842589028f875c22cc9f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "546d025cdba842589028f875c22cc9f7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 37049 } } }
I20260923 19:47:06.834731 3092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:06.835429 3100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:06.841876 3100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:06.849933 3100 catalog_manager.cc:1347] Generated new cluster ID: 6a06e2feea1249b988e9e3da1ef0b4d3
I20260923 19:47:06.850059 3100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:06.864926 3100 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:06.866791 3100 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:06.885998 3100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 546d025cdba842589028f875c22cc9f7: Generated new TSK 0
I20260923 19:47:06.887081 3100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:06.899824 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3014
W20260923 19:47:06.900929 3076 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46907
W20260923 19:47:06.901690 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3014: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:47:06.901839 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3014
W20260923 19:47:06.918748 2999 connection.cc:535] client connection to 127.13.88.254:37049 recv error: Network error: failed to read from TLS socket (remote: 127.13.88.254:37049): Connection reset by peer (error 104)
2026-09-23T19:47:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1867 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:06 dist-test-slave-xg7f krb5kdc[3112](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:06 dist-test-slave-xg7f krb5kdc[3112](info): set up 2 sockets
Sep 23 19:47:06 dist-test-slave-xg7f krb5kdc[3112](info): commencing operation
krb5kdc: starting...
W20260923 19:47:07.987586 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.003s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:08 dist-test-slave-xg7f krb5kdc[3112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:08.236213 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:44529
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:46085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:44529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:08.557504 3125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:08.557790 3125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:08.557883 3125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:08.565053 3125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:08.565150 3125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:08.565194 3125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:08.565244 3125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:08.565291 3125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:08.574729 3125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:46085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:44529
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:44529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:08.575918 3125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:08.577438 3125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:08.588690 3130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:08.588762 3131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:08.588724 3133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:08.589568 3125 server_base.cc:1034] running on GCE node
I20260923 19:47:08.590296 3125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:08.591715 3125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:08.592962 3125 hybrid_clock.cc:648] HybridClock initialized: now 1790192828592921 us; error 49 us; skew 500 ppm
I20260923 19:47:08.593294 3125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:08 dist-test-slave-xg7f krb5kdc[3112](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192828, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:08.612123 3125 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:08.613807 3125 webserver.cc:460] Webserver started at http://127.13.88.254:46705/ using document root <none> and password file <none>
I20260923 19:47:08.614530 3125 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:08.614686 3125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:08.614997 3125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:08.618042 3125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "3584b87313f94843adef3ccdf245fd29"
format_stamp: "Formatted at 2026-09-23 19:47:08 on dist-test-slave-xg7f"
server_key: "8d457a1f9c92beac869dadb8a8f8f4ae"
server_key_iv: "88657806702287e93815f84b1f2a505e"
server_key_version: "encryptionkey@0"
I20260923 19:47:08.618892 3125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "3584b87313f94843adef3ccdf245fd29"
format_stamp: "Formatted at 2026-09-23 19:47:08 on dist-test-slave-xg7f"
server_key: "8d457a1f9c92beac869dadb8a8f8f4ae"
server_key_iv: "88657806702287e93815f84b1f2a505e"
server_key_version: "encryptionkey@0"
I20260923 19:47:08.623960 3125 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 19:47:08.627276 3140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:08.628523 3125 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:47:08.628728 3125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "3584b87313f94843adef3ccdf245fd29"
format_stamp: "Formatted at 2026-09-23 19:47:08 on dist-test-slave-xg7f"
server_key: "8d457a1f9c92beac869dadb8a8f8f4ae"
server_key_iv: "88657806702287e93815f84b1f2a505e"
server_key_version: "encryptionkey@0"
I20260923 19:47:08.628932 3125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:08.634531 3125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:08.638301 3125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:08.638577 3125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:08.657162 3125 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:44529
I20260923 19:47:08.657212 3191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:44529 every 8 connection(s)
I20260923 19:47:08.658493 3125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:08.659587 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3125
I20260923 19:47:08.659782 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:08.660317 13667 external_mini_cluster.cc:1428] Setting key a76f5035b6b89486acb7879282d2de84
I20260923 19:47:08.663242 3192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:08.667889 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:08.662079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58215 (local address 127.13.88.254:44529)
0923 19:47:08.662804 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:08.662815 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:08.662882 (+ 67us) server_negotiation.cc:407] Connection header received
0923 19:47:08.664590 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:08.664611 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:08.664919 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:08.665318 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:08.666318 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:08.666323 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:08.666335 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:08.666352 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:08.666412 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:08.666429 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:08.666670 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:08.666821 (+ 151us) server_negotiation.cc:299] Negotiation successful
0923 19:47:08.666987 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":321,"threads_started":1}
I20260923 19:47:08.671459 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:08.674522 3192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29: Bootstrap starting.
I20260923 19:47:08.677933 3195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:08.675603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50525 (local address 127.13.88.254:44529)
0923 19:47:08.675769 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:08.675775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:08.676205 (+ 430us) server_negotiation.cc:407] Connection header received
0923 19:47:08.676322 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:08.676328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:08.676383 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:08.676500 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:08.677331 (+ 831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:08.677336 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:08.677340 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:08.677358 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:08.677402 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:08.677423 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:08.677532 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:08.677609 (+ 77us) server_negotiation.cc:299] Negotiation successful
0923 19:47:08.677660 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:47:08.678112 3192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:08.679351 3192 log.cc:824] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:08.681821 3192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29: No bootstrap required, opened a new log
I20260923 19:47:08.688946 3192 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3584b87313f94843adef3ccdf245fd29" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44529 } }
I20260923 19:47:08.689257 3192 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:08.689317 3192 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3584b87313f94843adef3ccdf245fd29, State: Initialized, Role: FOLLOWER
I20260923 19:47:08.689790 3192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3584b87313f94843adef3ccdf245fd29" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44529 } }
I20260923 19:47:08.689970 3192 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:08.690061 3192 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:08.690177 3192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:08.692476 3192 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3584b87313f94843adef3ccdf245fd29" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44529 } }
I20260923 19:47:08.692982 3192 leader_election.cc:302] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3584b87313f94843adef3ccdf245fd29; no voters:
I20260923 19:47:08.693449 3192 leader_election.cc:288] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:08.693601 3202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:08.694283 3202 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [term 1 LEADER]: Becoming Leader. State: Replica: 3584b87313f94843adef3ccdf245fd29, State: Running, Role: LEADER
I20260923 19:47:08.694751 3202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3584b87313f94843adef3ccdf245fd29" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44529 } }
I20260923 19:47:08.695466 3192 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:08.697361 3204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3584b87313f94843adef3ccdf245fd29. Latest consensus state: current_term: 1 leader_uuid: "3584b87313f94843adef3ccdf245fd29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3584b87313f94843adef3ccdf245fd29" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44529 } } }
I20260923 19:47:08.697726 3204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:08.699149 3203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3584b87313f94843adef3ccdf245fd29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3584b87313f94843adef3ccdf245fd29" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 44529 } } }
I20260923 19:47:08.699389 3207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:08.699474 3203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:08.704521 3207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:08.712131 3207 catalog_manager.cc:1347] Generated new cluster ID: e155df823de6423fac2ebde77beb36b9
I20260923 19:47:08.712229 3207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:08.728174 3207 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:08.728582 3207 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:08.734483 3207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3584b87313f94843adef3ccdf245fd29: Generated new TSK 0
I20260923 19:47:08.735248 3207 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:08.743690 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3125
W20260923 19:47:08.744705 3187 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58215
W20260923 19:47:08.745416 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3125: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:47:08.745569 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3125
2026-09-23T19:47:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1840 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:08 dist-test-slave-xg7f krb5kdc[3223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:08 dist-test-slave-xg7f krb5kdc[3223](info): set up 2 sockets
Sep 23 19:47:08 dist-test-slave-xg7f krb5kdc[3223](info): commencing operation
krb5kdc: starting...
W20260923 19:47:09.823693 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.010s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:09 dist-test-slave-xg7f krb5kdc[3223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:10.065501 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45395
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:35781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:10.389019 3236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:10.389304 3236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:10.389470 3236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:10.396847 3236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:10.396956 3236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:10.397094 3236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:10.397181 3236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:10.397259 3236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:10.407418 3236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:35781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:10.408751 3236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:10.410104 3236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:10.421818 3241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:10.421720 3244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:10.421885 3242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:10.422765 3236 server_base.cc:1034] running on GCE node
I20260923 19:47:10.423650 3236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:10.425252 3236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:10.426510 3236 hybrid_clock.cc:648] HybridClock initialized: now 1790192830426431 us; error 63 us; skew 500 ppm
I20260923 19:47:10.426877 3236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:10 dist-test-slave-xg7f krb5kdc[3223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192830, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:10.430050 3236 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:10.431681 3236 webserver.cc:460] Webserver started at http://127.13.88.254:34245/ using document root <none> and password file <none>
I20260923 19:47:10.432399 3236 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:10.432545 3236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:10.432849 3236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:10.435927 3236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "97e6717bb8754f6b8bf2621c2fad0d84"
format_stamp: "Formatted at 2026-09-23 19:47:10 on dist-test-slave-xg7f"
server_key: "2b302bfce04290faa80a31bd141f3f24"
server_key_iv: "6e7f4b116737d89ef256899dc7003aba"
server_key_version: "encryptionkey@0"
I20260923 19:47:10.436688 3236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "97e6717bb8754f6b8bf2621c2fad0d84"
format_stamp: "Formatted at 2026-09-23 19:47:10 on dist-test-slave-xg7f"
server_key: "2b302bfce04290faa80a31bd141f3f24"
server_key_iv: "6e7f4b116737d89ef256899dc7003aba"
server_key_version: "encryptionkey@0"
I20260923 19:47:10.441735 3236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 19:47:10.445035 3251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:10.446357 3236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:47:10.446537 3236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "97e6717bb8754f6b8bf2621c2fad0d84"
format_stamp: "Formatted at 2026-09-23 19:47:10 on dist-test-slave-xg7f"
server_key: "2b302bfce04290faa80a31bd141f3f24"
server_key_iv: "6e7f4b116737d89ef256899dc7003aba"
server_key_version: "encryptionkey@0"
I20260923 19:47:10.446728 3236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:10.493326 3236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:10.497357 3236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:10.497649 3236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:10.515949 3236 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:45395
I20260923 19:47:10.515985 3302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:45395 every 8 connection(s)
I20260923 19:47:10.517280 3236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:10.518275 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3236
I20260923 19:47:10.518435 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:10.518807 13667 external_mini_cluster.cc:1428] Setting key 011a01d6ca68bad082201b973e35150e
I20260923 19:47:10.521754 3303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Sep 23 19:47:10 dist-test-slave-xg7f krb5kdc[3223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:47:10.534704 3303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84: Bootstrap starting.
I20260923 19:47:10.538646 3303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:10.539875 3303 log.cc:824] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:10.542037 3306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:10.520663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43789 (local address 127.13.88.254:45395)
0923 19:47:10.521371 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:10.521382 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:10.521421 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:47:10.523152 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:10.523179 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:10.523552 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:10.523889 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:10.525532 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:10.526816 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:10.528542 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:10.529246 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:10.529359 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:10.533934 (+ 4575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:10.533945 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:10.533962 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:10.534011 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:10.537849 (+ 3838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:10.538512 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:10.538525 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:10.538535 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:10.538751 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:10.539125 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:10.539130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:10.539133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:10.539791 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:10.540073 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:10.540519 (+ 446us) server_negotiation.cc:299] Negotiation successful
0923 19:47:10.540885 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":302,"threads_started":1}
I20260923 19:47:10.543159 3303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84: No bootstrap required, opened a new log
I20260923 19:47:10.545846 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:10.553869 3303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45395 } }
I20260923 19:47:10.554287 3303 raft_consensus.cc:374] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:10.554406 3303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e6717bb8754f6b8bf2621c2fad0d84, State: Initialized, Role: FOLLOWER
I20260923 19:47:10.554992 3303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45395 } }
I20260923 19:47:10.555308 3303 raft_consensus.cc:388] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:10.555447 3303 raft_consensus.cc:482] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:10.555615 3303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:10.557801 3303 raft_consensus.cc:504] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45395 } }
I20260923 19:47:10.558284 3303 leader_election.cc:302] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97e6717bb8754f6b8bf2621c2fad0d84; no voters:
I20260923 19:47:10.558883 3303 leader_election.cc:288] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:10.558998 3313 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:10.561748 3303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:10.563359 3313 raft_consensus.cc:686] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [term 1 LEADER]: Becoming Leader. State: Replica: 97e6717bb8754f6b8bf2621c2fad0d84, State: Running, Role: LEADER
I20260923 19:47:10.564180 3313 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45395 } }
I20260923 19:47:10.565156 3306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:10.551041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59735 (local address 127.13.88.254:45395)
0923 19:47:10.551253 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:10.551259 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:10.551776 (+ 517us) server_negotiation.cc:407] Connection header received
0923 19:47:10.551953 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:10.551957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:10.552015 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:10.552088 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:10.553790 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:10.554655 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:10.556086 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:10.556591 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:10.556732 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:10.559081 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:10.559088 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:10.559094 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:10.559162 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:10.562401 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:10.563035 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:10.563040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:10.563044 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:10.563258 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:10.563701 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:10.563704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:10.563706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:10.563965 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:10.564252 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:10.564549 (+ 297us) server_negotiation.cc:299] Negotiation successful
0923 19:47:10.564770 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260923 19:47:10.571339 3314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97e6717bb8754f6b8bf2621c2fad0d84. Latest consensus state: current_term: 1 leader_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45395 } } }
I20260923 19:47:10.571821 3314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:10.571733 3315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97e6717bb8754f6b8bf2621c2fad0d84" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45395 } } }
I20260923 19:47:10.572005 3315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:10.583161 3320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:10.588925 3320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:10.598202 3320 catalog_manager.cc:1347] Generated new cluster ID: bbf54d3cf435488dbe677b016e23e592
I20260923 19:47:10.598300 3320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:10.625885 3320 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:10.627898 3320 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:10.637910 3320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 97e6717bb8754f6b8bf2621c2fad0d84: Generated new TSK 0
I20260923 19:47:10.638952 3320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:10.646052 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3236
I20260923 19:47:10.651968 3298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:10.748667 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3236
2026-09-23T19:47:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2006 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:10 dist-test-slave-xg7f krb5kdc[3336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:10 dist-test-slave-xg7f krb5kdc[3336](info): set up 2 sockets
Sep 23 19:47:10 dist-test-slave-xg7f krb5kdc[3336](info): commencing operation
krb5kdc: starting...
W20260923 19:47:11.839633 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:11 dist-test-slave-xg7f krb5kdc[3336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:12.076195 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45901
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:45901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:12.409529 3349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:12.409914 3349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:12.410097 3349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:12.417699 3349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:12.417888 3349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:12.418004 3349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:12.418120 3349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:12.418205 3349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:12.428630 3349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:45901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:45901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:12.430058 3349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:12.431524 3349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:12.444039 3354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:12.443969 3357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:12.444001 3355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:12.445070 3349 server_base.cc:1034] running on GCE node
I20260923 19:47:12.445930 3349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:12.447492 3349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:12.448715 3349 hybrid_clock.cc:648] HybridClock initialized: now 1790192832448656 us; error 58 us; skew 500 ppm
I20260923 19:47:12.449064 3349 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:12 dist-test-slave-xg7f krb5kdc[3336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192832, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:12.452407 3349 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:12.453962 3349 webserver.cc:460] Webserver started at http://127.13.88.254:43791/ using document root <none> and password file <none>
I20260923 19:47:12.454736 3349 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:12.454890 3349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:12.455261 3349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:12.458391 3349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "1d6510853d26480183ff206bde32ac42"
format_stamp: "Formatted at 2026-09-23 19:47:12 on dist-test-slave-xg7f"
server_key: "c4c24aad8776bb427eb9912e57fc86f6"
server_key_iv: "de2b373781f01cfd79542782277de471"
server_key_version: "encryptionkey@0"
I20260923 19:47:12.459327 3349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "1d6510853d26480183ff206bde32ac42"
format_stamp: "Formatted at 2026-09-23 19:47:12 on dist-test-slave-xg7f"
server_key: "c4c24aad8776bb427eb9912e57fc86f6"
server_key_iv: "de2b373781f01cfd79542782277de471"
server_key_version: "encryptionkey@0"
I20260923 19:47:12.464517 3349 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:47:12.468052 3364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:12.469462 3349 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 19:47:12.469653 3349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "1d6510853d26480183ff206bde32ac42"
format_stamp: "Formatted at 2026-09-23 19:47:12 on dist-test-slave-xg7f"
server_key: "c4c24aad8776bb427eb9912e57fc86f6"
server_key_iv: "de2b373781f01cfd79542782277de471"
server_key_version: "encryptionkey@0"
I20260923 19:47:12.469899 3349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:12.489543 3349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:12.494211 3349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:12.494522 3349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:12.512506 3349 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:45901
I20260923 19:47:12.512512 3415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:45901 every 8 connection(s)
I20260923 19:47:12.513923 3349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:12.517897 3416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:12.519878 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3349
I20260923 19:47:12.520099 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:12.520524 13667 external_mini_cluster.cc:1428] Setting key eee86087ad5c91685493bb047dd6acdc
I20260923 19:47:12.531339 3416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42: Bootstrap starting.
I20260923 19:47:12.535166 3416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:12.535787 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:12.522367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36629 (local address 127.13.88.254:45901)
0923 19:47:12.523211 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:12.523227 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:12.523283 (+ 56us) server_negotiation.cc:407] Connection header received
0923 19:47:12.525596 (+ 2313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:12.525625 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:12.526170 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:12.526610 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:12.527239 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:12.529235 (+ 1996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:12.530639 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:12.531700 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:12.531908 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:12.533010 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:12.533020 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:12.533041 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:12.533765 (+ 724us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:12.533866 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:12.533900 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:12.534000 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:12.534189 (+ 189us) server_negotiation.cc:299] Negotiation successful
0923 19:47:12.534448 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":318,"threads_started":1}
I20260923 19:47:12.536424 3416 log.cc:824] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:12.539570 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:12.539580 3416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42: No bootstrap required, opened a new log
I20260923 19:47:12.547681 3416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6510853d26480183ff206bde32ac42" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45901 } }
I20260923 19:47:12.548206 3416 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:12.548313 3416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d6510853d26480183ff206bde32ac42, State: Initialized, Role: FOLLOWER
I20260923 19:47:12.548950 3416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6510853d26480183ff206bde32ac42" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45901 } }
I20260923 19:47:12.549199 3416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:12.549338 3416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:12.549530 3416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:12.550259 3419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:12.543942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42035 (local address 127.13.88.254:45901)
0923 19:47:12.544117 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:12.544122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:12.544498 (+ 376us) server_negotiation.cc:407] Connection header received
0923 19:47:12.544639 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:12.544644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:12.544720 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:12.544820 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:12.545239 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:12.546350 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:12.547678 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:12.548304 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:12.548435 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:12.549494 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:12.549500 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:12.549505 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:12.549532 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:12.549587 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:12.549611 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:12.549703 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:12.549840 (+ 137us) server_negotiation.cc:299] Negotiation successful
0923 19:47:12.549940 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 19:47:12.552484 3416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6510853d26480183ff206bde32ac42" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45901 } }
I20260923 19:47:12.553002 3416 leader_election.cc:302] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d6510853d26480183ff206bde32ac42; no voters:
I20260923 19:47:12.553653 3416 leader_election.cc:288] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:12.553788 3426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:12.554414 3426 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [term 1 LEADER]: Becoming Leader. State: Replica: 1d6510853d26480183ff206bde32ac42, State: Running, Role: LEADER
I20260923 19:47:12.555028 3426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6510853d26480183ff206bde32ac42" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45901 } }
I20260923 19:47:12.556037 3416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:12.557956 3427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d6510853d26480183ff206bde32ac42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6510853d26480183ff206bde32ac42" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45901 } } }
I20260923 19:47:12.558007 3428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d6510853d26480183ff206bde32ac42. Latest consensus state: current_term: 1 leader_uuid: "1d6510853d26480183ff206bde32ac42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d6510853d26480183ff206bde32ac42" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 45901 } } }
I20260923 19:47:12.558439 3427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:12.558490 3428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:12.564328 3433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:12.568624 3433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:12.577430 3433 catalog_manager.cc:1347] Generated new cluster ID: 968acad425f641048d1687211fc6ec05
I20260923 19:47:12.577562 3433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:12.584880 3433 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:12.586730 3433 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:12.594712 3433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d6510853d26480183ff206bde32ac42: Generated new TSK 0
I20260923 19:47:12.595798 3433 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:12.602504 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3349
W20260923 19:47:12.603561 3411 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36629
W20260923 19:47:12.604240 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3349: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:47:12.604386 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3349
2026-09-23T19:47:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1855 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:12 dist-test-slave-xg7f krb5kdc[3447](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:12 dist-test-slave-xg7f krb5kdc[3447](info): set up 2 sockets
Sep 23 19:47:12 dist-test-slave-xg7f krb5kdc[3447](info): commencing operation
krb5kdc: starting...
W20260923 19:47:13.719823 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:13 dist-test-slave-xg7f krb5kdc[3447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:13.981588 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43295
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:46065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:14.321369 3460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:14.321688 3460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:14.321844 3460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:14.329109 3460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:14.329223 3460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:14.329334 3460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:14.329452 3460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:14.329514 3460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:14.339661 3460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:46065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:14.341039 3460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:14.342386 3460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:14.354184 3465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:14.354225 3468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:14.354225 3466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:14.355079 3460 server_base.cc:1034] running on GCE node
I20260923 19:47:14.355986 3460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:14.357487 3460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:14.358752 3460 hybrid_clock.cc:648] HybridClock initialized: now 1790192834358701 us; error 44 us; skew 500 ppm
I20260923 19:47:14.359206 3460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:14 dist-test-slave-xg7f krb5kdc[3447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192834, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:14.368607 3460 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:14.370242 3460 webserver.cc:460] Webserver started at http://127.13.88.254:36893/ using document root <none> and password file <none>
I20260923 19:47:14.370954 3460 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:14.371061 3460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:14.371392 3460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:14.374554 3460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "e013ba19877b447f96bd00a0de67dfc8"
format_stamp: "Formatted at 2026-09-23 19:47:14 on dist-test-slave-xg7f"
server_key: "312dbb3780ced519d26290b25462583d"
server_key_iv: "a7b71bb39e03cf9461d036de48f25201"
server_key_version: "encryptionkey@0"
I20260923 19:47:14.375384 3460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "e013ba19877b447f96bd00a0de67dfc8"
format_stamp: "Formatted at 2026-09-23 19:47:14 on dist-test-slave-xg7f"
server_key: "312dbb3780ced519d26290b25462583d"
server_key_iv: "a7b71bb39e03cf9461d036de48f25201"
server_key_version: "encryptionkey@0"
I20260923 19:47:14.380674 3460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260923 19:47:14.384223 3475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:14.385599 3460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:47:14.385741 3460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "e013ba19877b447f96bd00a0de67dfc8"
format_stamp: "Formatted at 2026-09-23 19:47:14 on dist-test-slave-xg7f"
server_key: "312dbb3780ced519d26290b25462583d"
server_key_iv: "a7b71bb39e03cf9461d036de48f25201"
server_key_version: "encryptionkey@0"
I20260923 19:47:14.385918 3460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:14.391878 3460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:14.395723 3460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:14.395985 3460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:14.414462 3460 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:43295
I20260923 19:47:14.414501 3526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:43295 every 8 connection(s)
I20260923 19:47:14.416014 3460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:14.417017 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3460
I20260923 19:47:14.417184 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:14.417565 13667 external_mini_cluster.cc:1428] Setting key 1b07911daae4ff33f848ba987e487217
I20260923 19:47:14.420292 3527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:14.425467 3530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:14.419399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55119 (local address 127.13.88.254:43295)
0923 19:47:14.420158 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:14.420170 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:14.420209 (+ 39us) server_negotiation.cc:407] Connection header received
0923 19:47:14.421978 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:14.422004 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:14.422354 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:14.422737 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:14.423834 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:14.423840 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:14.423853 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:14.423866 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:14.423933 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:14.423960 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:14.424202 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:14.424339 (+ 137us) server_negotiation.cc:299] Negotiation successful
0923 19:47:14.424531 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":338,"threads_started":1}
I20260923 19:47:14.429371 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:14.432507 3527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8: Bootstrap starting.
I20260923 19:47:14.436204 3530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:14.433623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42379 (local address 127.13.88.254:43295)
0923 19:47:14.433805 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:14.433811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:14.434333 (+ 522us) server_negotiation.cc:407] Connection header received
0923 19:47:14.434510 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:14.434516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:14.434579 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:14.434695 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:14.435560 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:14.435565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:14.435569 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 19:47:14.435589 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:14.435638 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 19:47:14.435667 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:14.435795 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:14.435861 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 19:47:14.435924 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:47:14.436476 3527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:14.437686 3527 log.cc:824] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:14.440722 3527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8: No bootstrap required, opened a new log
I20260923 19:47:14.447582 3527 raft_consensus.cc:348] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e013ba19877b447f96bd00a0de67dfc8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43295 } }
I20260923 19:47:14.448022 3527 raft_consensus.cc:374] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:47:14.448099 3527 raft_consensus.cc:729] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e013ba19877b447f96bd00a0de67dfc8, State: Initialized, Role: FOLLOWER
I20260923 19:47:14.448592 3527 consensus_queue.cc:260] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e013ba19877b447f96bd00a0de67dfc8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43295 } }
I20260923 19:47:14.448776 3527 raft_consensus.cc:388] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 19:47:14.448868 3527 raft_consensus.cc:482] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 19:47:14.448987 3527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:14.451083 3527 raft_consensus.cc:504] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e013ba19877b447f96bd00a0de67dfc8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43295 } }
I20260923 19:47:14.451617 3527 leader_election.cc:302] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e013ba19877b447f96bd00a0de67dfc8; no voters:
I20260923 19:47:14.452139 3527 leader_election.cc:288] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 19:47:14.452292 3537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:14.453022 3537 raft_consensus.cc:686] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [term 1 LEADER]: Becoming Leader. State: Replica: e013ba19877b447f96bd00a0de67dfc8, State: Running, Role: LEADER
I20260923 19:47:14.453639 3537 consensus_queue.cc:237] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e013ba19877b447f96bd00a0de67dfc8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43295 } }
I20260923 19:47:14.454495 3527 sys_catalog.cc:564] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:14.456646 3538 sys_catalog.cc:455] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e013ba19877b447f96bd00a0de67dfc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e013ba19877b447f96bd00a0de67dfc8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43295 } } }
I20260923 19:47:14.457141 3538 sys_catalog.cc:458] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:14.457934 3539 sys_catalog.cc:455] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e013ba19877b447f96bd00a0de67dfc8. Latest consensus state: current_term: 1 leader_uuid: "e013ba19877b447f96bd00a0de67dfc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e013ba19877b447f96bd00a0de67dfc8" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43295 } } }
I20260923 19:47:14.458282 3539 sys_catalog.cc:458] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:14.458724 3544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 19:47:14.464499 3544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:14.473265 3544 catalog_manager.cc:1347] Generated new cluster ID: 50c286d488d84e908ef228fd0d9c06d1
I20260923 19:47:14.473379 3544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:14.514550 3544 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:14.515025 3544 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:14.528687 3544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e013ba19877b447f96bd00a0de67dfc8: Generated new TSK 0
I20260923 19:47:14.529557 3544 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:14.543365 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3460
W20260923 19:47:14.544452 3522 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55119
W20260923 19:47:14.545146 13667 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3460: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260923 19:47:14.545323 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3460
2026-09-23T19:47:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1940 ms)
[----------] 18 tests from AuthTokenIssuingTest (34336 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:14 dist-test-slave-xg7f krb5kdc[3558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:14 dist-test-slave-xg7f krb5kdc[3558](info): set up 2 sockets
Sep 23 19:47:14 dist-test-slave-xg7f krb5kdc[3558](info): commencing operation
krb5kdc: starting...
W20260923 19:47:15.643731 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.003s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:15 dist-test-slave-xg7f krb5kdc[3558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:15.896067 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43885
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43885,127.13.88.253:40819,127.13.88.252:40503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:16.223708 3571 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:47:16.224054 3571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:16.224171 3571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:16.224313 3571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:16.231657 3571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:16.231752 3571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:16.231855 3571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:16.231925 3571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:16.232013 3571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:16.242079 3571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43885,127.13.88.253:40819,127.13.88.252:40503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:16.243480 3571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:16.244760 3571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:16.256246 3579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:16.256325 3577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:16.256289 3576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:16.257095 3571 server_base.cc:1034] running on GCE node
I20260923 19:47:16.257761 3571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:16.259045 3571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:16.260280 3571 hybrid_clock.cc:648] HybridClock initialized: now 1790192836260232 us; error 33 us; skew 500 ppm
I20260923 19:47:16.260604 3571 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:16 dist-test-slave-xg7f krb5kdc[3558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:16.263500 3571 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:16.264732 3571 webserver.cc:460] Webserver started at http://127.13.88.254:43943/ using document root <none> and password file <none>
I20260923 19:47:16.265390 3571 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:16.265518 3571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:16.265821 3571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:16.268697 3571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "42d62e88d47346b6937f9b2dca2e91a5"
format_stamp: "Formatted at 2026-09-23 19:47:16 on dist-test-slave-xg7f"
server_key: "6d2d5934273dd658f9588a7357fed1c2"
server_key_iv: "1b2c3670f7b9e99a6ccb3e79455567cb"
server_key_version: "encryptionkey@0"
I20260923 19:47:16.269469 3571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "42d62e88d47346b6937f9b2dca2e91a5"
format_stamp: "Formatted at 2026-09-23 19:47:16 on dist-test-slave-xg7f"
server_key: "6d2d5934273dd658f9588a7357fed1c2"
server_key_iv: "1b2c3670f7b9e99a6ccb3e79455567cb"
server_key_version: "encryptionkey@0"
I20260923 19:47:16.274511 3571 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260923 19:47:16.277935 3586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:16.279327 3571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:47:16.279506 3571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "42d62e88d47346b6937f9b2dca2e91a5"
format_stamp: "Formatted at 2026-09-23 19:47:16 on dist-test-slave-xg7f"
server_key: "6d2d5934273dd658f9588a7357fed1c2"
server_key_iv: "1b2c3670f7b9e99a6ccb3e79455567cb"
server_key_version: "encryptionkey@0"
I20260923 19:47:16.279721 3571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:16.292397 3571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:16.296221 3571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:16.296497 3571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:16.314719 3571 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:43885
I20260923 19:47:16.314742 3637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:43885 every 8 connection(s)
I20260923 19:47:16.316120 3571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:16.319849 3638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:16.321138 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3571
I20260923 19:47:16.321372 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:16.322193 13667 external_mini_cluster.cc:1428] Setting key 4707731e0d17fc72d372a0597dd4fbe8
I20260923 19:47:16.329980 3638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:16 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.253@KRBTEST.COM" created.
I20260923 19:47:16.353605 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.334161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43885 (local address 127.0.0.1:40480)
0923 19:47:16.335019 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.335075 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:16.337100 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:16.337915 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:16.337922 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:16.338666 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:16.338995 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:16.339012 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.340594 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.340599 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:16.341675 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:16.341687 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.342616 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.342622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:16.342797 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:16.343505 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:16.343535 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:16.345781 (+ 2246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:16.349140 (+ 3359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:16.349152 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:16.349166 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:16.349561 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:16.349940 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:16.349947 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:16.349953 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:16.350172 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:16.351015 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:16.351028 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:16.351271 (+ 243us) client_negotiation.cc:769] Sending connection context
0923 19:47:16.351520 (+ 249us) client_negotiation.cc:240] Negotiation successful
0923 19:47:16.352121 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":147,"thread_start_us":362,"threads_started":1}
I20260923 19:47:16.353623 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.334161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40480 (local address 127.13.88.254:43885)
0923 19:47:16.335861 (+ 1700us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:16.335873 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:16.335920 (+ 47us) server_negotiation.cc:407] Connection header received
0923 19:47:16.337466 (+ 1546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:16.337471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:16.337698 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:16.337888 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:16.339239 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.340427 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.341816 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.342371 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.342570 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:16.346007 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:16.346016 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:16.346036 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:16.346065 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:16.349015 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:16.349694 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:16.349701 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:16.349703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:16.349836 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:16.350318 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:16.350322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:16.350325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:16.350867 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:16.351125 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:16.351655 (+ 530us) server_negotiation.cc:299] Negotiation successful
0923 19:47:16.352011 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1484,"thread_start_us":1282,"threads_started":1}
I20260923 19:47:16.356716 3638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:47:16.357836 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.357381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38236)
0923 19:47:16.357584 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.357718 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260923 19:47:16.358078 3589 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
I20260923 19:47:16.359625 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.359296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38252)
0923 19:47:16.359436 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.359497 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 19:47:16.359818 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:40819: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab.
Entry for principal kudu/127.13.88.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab.
I20260923 19:47:16.379515 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:40819
--webserver_interface=127.13.88.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab
--principal=kudu/127.13.88.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43885,127.13.88.253:40819,127.13.88.252:40503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:47:16.409221 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } attempt: 1
I20260923 19:47:16.410401 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.409948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38258)
0923 19:47:16.410145 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.410254 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260923 19:47:16.411437 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.411061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38260)
0923 19:47:16.411253 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.411314 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260923 19:47:16.411621 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:40819: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
I20260923 19:47:16.479839 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } attempt: 2
I20260923 19:47:16.480999 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.480504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38268)
0923 19:47:16.480774 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.480862 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260923 19:47:16.482031 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.481685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38278)
0923 19:47:16.481819 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.481904 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260923 19:47:16.482208 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:40819: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
I20260923 19:47:16.573519 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } attempt: 3
I20260923 19:47:16.574590 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.574169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38284)
0923 19:47:16.574358 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.574454 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260923 19:47:16.575675 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.575319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38296)
0923 19:47:16.575453 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.575539 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260923 19:47:16.575842 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:40819: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
W20260923 19:47:16.711593 3645 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:47:16.711983 3645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:16.712101 3645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:16.712230 3645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 19:47:16.719141 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } attempt: 4
W20260923 19:47:16.719525 3645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:16.719635 3645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:16.719730 3645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:16.719823 3645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:16.719921 3645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:16.720491 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.719887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38300)
0923 19:47:16.720219 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.720326 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260923 19:47:16.721524 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.721149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38302)
0923 19:47:16.721291 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.721381 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 19:47:16.721700 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:40819: Network error: Client connection negotiation failed: client connection to 127.13.88.253:40819: connect: Connection refused (error 111)
I20260923 19:47:16.730692 3645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43885,127.13.88.253:40819,127.13.88.252:40503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab
--principal=kudu/127.13.88.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:40819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.88.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:16.732051 3645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:16.733385 3645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:16.744985 3651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:16.744988 3650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:16.744884 3653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:16.745951 3645 server_base.cc:1034] running on GCE node
I20260923 19:47:16.746776 3645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:16.748163 3645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:16.749416 3645 hybrid_clock.cc:648] HybridClock initialized: now 1790192836749338 us; error 57 us; skew 500 ppm
I20260923 19:47:16.749739 3645 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:16 dist-test-slave-xg7f krb5kdc[3558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:16.752801 3645 init.cc:377] Logged in from keytab as kudu/127.13.88.253@KRBTEST.COM (short username kudu)
I20260923 19:47:16.754196 3645 webserver.cc:460] Webserver started at http://127.13.88.253:46729/ using document root <none> and password file <none>
I20260923 19:47:16.754845 3645 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:16.754926 3645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:16.755293 3645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:16.758134 3645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data/instance:
uuid: "53a84307d96248e39e646cc6154c38ae"
format_stamp: "Formatted at 2026-09-23 19:47:16 on dist-test-slave-xg7f"
server_key: "eb3528f989aad82def7b96e17618618e"
server_key_iv: "d3a54399c21a95d8486048e561f169ef"
server_key_version: "encryptionkey@0"
I20260923 19:47:16.758867 3645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/wal/instance:
uuid: "53a84307d96248e39e646cc6154c38ae"
format_stamp: "Formatted at 2026-09-23 19:47:16 on dist-test-slave-xg7f"
server_key: "eb3528f989aad82def7b96e17618618e"
server_key_iv: "d3a54399c21a95d8486048e561f169ef"
server_key_version: "encryptionkey@0"
I20260923 19:47:16.764120 3645 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 19:47:16.767498 3660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:16.768893 3645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260923 19:47:16.769058 3645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/wal
uuid: "53a84307d96248e39e646cc6154c38ae"
format_stamp: "Formatted at 2026-09-23 19:47:16 on dist-test-slave-xg7f"
server_key: "eb3528f989aad82def7b96e17618618e"
server_key_iv: "d3a54399c21a95d8486048e561f169ef"
server_key_version: "encryptionkey@0"
I20260923 19:47:16.769263 3645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:16.798301 3645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:16.802464 3645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:16.802752 3645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:16.821780 3645 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.253:40819
I20260923 19:47:16.821787 3711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.253:40819 every 8 connection(s)
I20260923 19:47:16.823251 3645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
I20260923 19:47:16.824796 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3645
I20260923 19:47:16.824978 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-1/wal/instance
I20260923 19:47:16.825418 13667 external_mini_cluster.cc:1428] Setting key c11f02d3a380f207c551bccb5c324ba4
I20260923 19:47:16.827283 3712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:16.833750 3712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.88.252@KRBTEST.COM; defaulting to no policy
Sep 23 19:47:16 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.252@KRBTEST.COM" created.
I20260923 19:47:16.854725 3642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.836305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40484 (local address 127.13.88.254:43885)
0923 19:47:16.836524 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:16.836530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:16.837759 (+ 1229us) server_negotiation.cc:407] Connection header received
0923 19:47:16.839694 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:16.839704 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:16.839805 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:16.839938 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:16.841389 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.842633 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.844176 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.844982 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.845153 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:16.848677 (+ 3524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:16.848682 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:16.848685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:16.848720 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:16.851506 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:16.852464 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:16.852468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:16.852471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:16.852592 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:16.853030 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:16.853034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:16.853035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:16.853295 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:16.853403 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:16.854305 (+ 902us) server_negotiation.cc:299] Negotiation successful
0923 19:47:16.854470 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 19:47:16.856307 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.836787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43885 (local address 127.0.0.1:40484)
0923 19:47:16.837580 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.837633 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:16.839420 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:16.840112 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:16.840120 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:16.840666 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:16.841217 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:16.841234 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.842783 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.842787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:16.844030 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:16.844043 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.845204 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.845209 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:16.845417 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:16.846100 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:16.846122 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:16.848425 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:16.851657 (+ 3232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:16.851669 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:16.851689 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:16.852344 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:16.852695 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:16.852702 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:16.852709 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:16.852926 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:16.853422 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:16.853433 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:16.853926 (+ 493us) client_negotiation.cc:769] Sending connection context
0923 19:47:16.854225 (+ 299us) client_negotiation.cc:240] Negotiation successful
0923 19:47:16.854803 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":324,"threads_started":1}
I20260923 19:47:16.858125 3712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:16 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:47:16.873708 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.858759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38308)
0923 19:47:16.858949 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.858966 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:16.859064 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:16.860345 (+ 1281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:16.860356 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:16.860905 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:16.861138 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:16.861152 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.862463 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.862471 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:16.864031 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:16.864047 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.864813 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.864823 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:16.865030 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:16.865702 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:16.865729 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:16.868144 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:16.871237 (+ 3093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:16.871242 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:16.871247 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:16.871599 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:16.871961 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:16.871966 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:16.871973 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:16.872110 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:16.872700 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:16.872704 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:16.872840 (+ 136us) client_negotiation.cc:769] Sending connection context
0923 19:47:16.873010 (+ 170us) client_negotiation.cc:240] Negotiation successful
0923 19:47:16.873312 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260923 19:47:16.873762 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.859139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38308 (local address 127.13.88.253:40819)
0923 19:47:16.859921 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:16.859927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:16.859949 (+ 22us) server_negotiation.cc:407] Connection header received
0923 19:47:16.859998 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:16.860003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:16.860189 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:16.860303 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:16.861305 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.862331 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.864152 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:16.864639 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:16.864729 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:16.868356 (+ 3627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:16.868367 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:16.868381 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:16.868408 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:16.871040 (+ 2632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:16.871737 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:16.871743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:16.871746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:16.871852 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:16.872236 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:16.872245 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:16.872247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:16.872588 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:16.872789 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:16.873149 (+ 360us) server_negotiation.cc:299] Negotiation successful
0923 19:47:16.873423 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":630,"thread_start_us":485,"threads_started":1}
I20260923 19:47:16.876363 3712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:47:16.877556 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.877130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47900)
0923 19:47:16.877295 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.877415 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 19:47:16.877813 3664 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
I20260923 19:47:16.879220 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.878874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47902)
0923 19:47:16.878985 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.879065 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260923 19:47:16.879472 3712 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab.
Entry for principal kudu/127.13.88.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab.
I20260923 19:47:16.884186 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:40503
--webserver_interface=127.13.88.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab
--principal=kudu/127.13.88.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:36273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43885,127.13.88.253:40819,127.13.88.252:40503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:47:16.928773 3712 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 1
I20260923 19:47:16.929960 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.929517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47906)
0923 19:47:16.929707 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.929809 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260923 19:47:16.930936 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:16.930591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47916)
0923 19:47:16.930750 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:16.930825 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 19:47:16.931167 3712 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
I20260923 19:47:16.999411 3712 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 2
I20260923 19:47:17.000553 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.000104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47926)
0923 19:47:17.000301 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.000395 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260923 19:47:17.001505 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.001190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47928)
0923 19:47:17.001333 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.001395 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260923 19:47:17.001713 3712 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
I20260923 19:47:17.020958 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } attempt: 5
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:47:17.040452 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.021695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38314)
0923 19:47:17.021959 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.021986 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:17.022144 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:17.022492 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:17.022497 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:17.023019 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:17.023329 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.023346 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.024356 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.024361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.025705 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.025720 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.026506 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.026511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.026725 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.027384 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:17.027403 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:17.030640 (+ 3237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:17.037755 (+ 7115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.037761 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.037766 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.038176 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.038630 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.038635 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.038639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.038786 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.039437 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:17.039443 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:17.039605 (+ 162us) client_negotiation.cc:769] Sending connection context
0923 19:47:17.039746 (+ 141us) client_negotiation.cc:240] Negotiation successful
0923 19:47:17.040098 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260923 19:47:17.040443 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.021808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38314 (local address 127.13.88.253:40819)
0923 19:47:17.021982 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.021986 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.022069 (+ 83us) server_negotiation.cc:407] Connection header received
0923 19:47:17.022268 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.022272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.022348 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.022431 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.023516 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.024221 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.025863 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.026336 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.026493 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.030966 (+ 4473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.030975 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.030981 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.031043 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.037556 (+ 6513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.038311 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.038318 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.038321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.038483 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.038904 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.038910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.038913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.039311 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.039471 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.039862 (+ 391us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.040091 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:47:17.041914 3638 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:47:17.042907 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.042519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47934)
0923 19:47:17.042686 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.042781 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260923 19:47:17.043860 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.043521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47946)
0923 19:47:17.043678 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.043762 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":51}
W20260923 19:47:17.044059 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
I20260923 19:47:17.095208 3712 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 3
I20260923 19:47:17.095292 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 1
I20260923 19:47:17.096477 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.095887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47960)
0923 19:47:17.096174 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.096279 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161}
I20260923 19:47:17.096503 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.095887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47962)
0923 19:47:17.096263 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.096341 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242}
I20260923 19:47:17.098264 3715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.097147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47974)
0923 19:47:17.097924 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.098038 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":651,"threads_started":1}
I20260923 19:47:17.102406 3641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.097196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47984)
0923 19:47:17.102069 (+ 4873us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.102191 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4728,"threads_started":1}
W20260923 19:47:17.109474 3712 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
W20260923 19:47:17.109596 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
I20260923 19:47:17.177830 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 2
I20260923 19:47:17.179608 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.178635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47988)
0923 19:47:17.178996 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.179294 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260923 19:47:17.181252 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.180713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:47996)
0923 19:47:17.180999 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.181094 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
W20260923 19:47:17.181613 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
I20260923 19:47:17.252740 3712 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 4
I20260923 19:47:17.254388 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.253607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:48008)
0923 19:47:17.253894 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.254137 (+ 243us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260923 19:47:17.255687 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.255307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:48024)
0923 19:47:17.255469 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.255555 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:47:17.255995 3712 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
W20260923 19:47:17.259207 3719 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:47:17.259488 3719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:17.259553 3719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:17.259625 3719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:17.267256 3719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:17.267370 3719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:17.267472 3719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:17.267562 3719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:17.267647 3719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:17.277647 3719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:36273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43885,127.13.88.253:40819,127.13.88.252:40503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab
--principal=kudu/127.13.88.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:40503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.88.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:17.278978 3719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:17.280378 3719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 19:47:17.287853 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 3
I20260923 19:47:17.288932 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.288472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:48026)
0923 19:47:17.288689 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.288776 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260923 19:47:17.289945 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.289555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:48034)
0923 19:47:17.289754 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.289848 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260923 19:47:17.290177 3638 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:40503: Network error: Client connection negotiation failed: client connection to 127.13.88.252:40503: connect: Connection refused (error 111)
W20260923 19:47:17.295092 3726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:17.295239 3727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:17.296537 3729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:17.297717 3719 server_base.cc:1034] running on GCE node
I20260923 19:47:17.298564 3719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:17.300012 3719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:17.301239 3719 hybrid_clock.cc:648] HybridClock initialized: now 1790192837301167 us; error 52 us; skew 500 ppm
I20260923 19:47:17.301566 3719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192837, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:17.305087 3719 init.cc:377] Logged in from keytab as kudu/127.13.88.252@KRBTEST.COM (short username kudu)
I20260923 19:47:17.306931 3719 webserver.cc:460] Webserver started at http://127.13.88.252:45385/ using document root <none> and password file <none>
I20260923 19:47:17.307976 3719 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:17.308111 3719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:17.308544 3719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:17.313241 3719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data/instance:
uuid: "6f4a5083e3254a4e872be3b5e81763cc"
format_stamp: "Formatted at 2026-09-23 19:47:17 on dist-test-slave-xg7f"
server_key: "831da690f2c6b76da392d2c49159b858"
server_key_iv: "ebbb8eb4ed8848749186fdef9f555f93"
server_key_version: "encryptionkey@0"
I20260923 19:47:17.314445 3719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/wal/instance:
uuid: "6f4a5083e3254a4e872be3b5e81763cc"
format_stamp: "Formatted at 2026-09-23 19:47:17 on dist-test-slave-xg7f"
server_key: "831da690f2c6b76da392d2c49159b858"
server_key_iv: "ebbb8eb4ed8848749186fdef9f555f93"
server_key_version: "encryptionkey@0"
I20260923 19:47:17.322045 3719 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260923 19:47:17.327167 3736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:17.329005 3719 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:47:17.329226 3719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/wal
uuid: "6f4a5083e3254a4e872be3b5e81763cc"
format_stamp: "Formatted at 2026-09-23 19:47:17 on dist-test-slave-xg7f"
server_key: "831da690f2c6b76da392d2c49159b858"
server_key_iv: "ebbb8eb4ed8848749186fdef9f555f93"
server_key_version: "encryptionkey@0"
I20260923 19:47:17.329562 3719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:17.349640 3719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:17.353693 3719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:17.353905 3719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:17.371613 3719 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.252:40503
I20260923 19:47:17.371620 3787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.252:40503 every 8 connection(s)
I20260923 19:47:17.373056 3719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
I20260923 19:47:17.376861 3788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:17.379586 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3719
I20260923 19:47:17.379755 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790192489293654-13667-0/minicluster-data/master-2/wal/instance
I20260923 19:47:17.380208 13667 external_mini_cluster.cc:1428] Setting key a9378cbad8ec9d4789b8f8eebb739272
I20260923 19:47:17.385047 3788 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192837, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:47:17.401973 3792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.387451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40490 (local address 127.13.88.254:43885)
0923 19:47:17.387977 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.387983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.388487 (+ 504us) server_negotiation.cc:407] Connection header received
0923 19:47:17.388683 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.388687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.388747 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.388829 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.390153 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.390886 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.392305 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.393025 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.393159 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.396445 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.396450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.396453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.396485 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.398956 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.399652 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.399660 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.399666 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.399813 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.400214 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.400219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.400222 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.400485 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.400630 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.401279 (+ 649us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.401514 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":243,"threads_started":1}
I20260923 19:47:17.403182 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.381970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48048 (local address 127.13.88.252:40503)
0923 19:47:17.382818 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.382835 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.383294 (+ 459us) server_negotiation.cc:407] Connection header received
0923 19:47:17.385103 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.385124 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.385516 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.385889 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.387491 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.389569 (+ 2078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.390791 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.391517 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.391713 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.395973 (+ 4260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.395983 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.395998 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.396038 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.399000 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.399723 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.399729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.399732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.399883 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.400247 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.400250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.400252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.400866 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.401161 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.401492 (+ 331us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.401764 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":585,"thread_start_us":358,"threads_started":1}
I20260923 19:47:17.403203 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.387499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43885 (local address 127.0.0.1:40490)
0923 19:47:17.388335 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.388382 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:17.388562 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:17.388916 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:17.388923 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:17.389726 (+ 803us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:17.389986 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.389994 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.391043 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.391052 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.392174 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.392189 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.393227 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.393231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.393352 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.393920 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:17.393941 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:17.396266 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:17.399083 (+ 2817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.399096 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.399164 (+ 68us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.399538 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.399923 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.399929 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.399934 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.400101 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.400618 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:17.400625 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:17.400863 (+ 238us) client_negotiation.cc:769] Sending connection context
0923 19:47:17.401155 (+ 292us) client_negotiation.cc:240] Negotiation successful
0923 19:47:17.401674 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":1,"thread_start_us":449,"threads_started":1}
I20260923 19:47:17.404839 3788 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192837, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:47:17.418174 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.405467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:40819 (local address 127.0.0.1:38328)
0923 19:47:17.405724 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.405759 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:17.405832 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:17.406145 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:17.406150 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:17.406566 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:17.406767 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.406778 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.407952 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.407958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.409002 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.409013 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.409732 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.409738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.409975 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.410564 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:17.410586 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:17.412686 (+ 2100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:17.415767 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.415771 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.415774 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.416291 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.416701 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.416705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.416707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.416864 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.417484 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:17.417487 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:17.417620 (+ 133us) client_negotiation.cc:769] Sending connection context
0923 19:47:17.417730 (+ 110us) client_negotiation.cc:240] Negotiation successful
0923 19:47:17.417936 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260923 19:47:17.418462 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.405637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.13.88.253:40819)
0923 19:47:17.405842 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.405848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.405866 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:47:17.405931 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.405935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.406012 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.406109 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.406921 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.407802 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.409136 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.409593 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.409686 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.412862 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.412867 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.412870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.412902 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.415640 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.416398 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.416407 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.416412 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.416597 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.416966 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.416972 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.416975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.417355 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.417508 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.417852 (+ 344us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.418060 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 19:47:17.419458 3788 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:47:17.421552 3792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.406718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40494 (local address 127.13.88.254:43885)
0923 19:47:17.406898 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.406903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.406922 (+ 19us) server_negotiation.cc:407] Connection header received
0923 19:47:17.407068 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.407073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.407167 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.407258 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.408491 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.409159 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.410693 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.411155 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.411255 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.415381 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.415389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.415396 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.415436 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.418744 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.419521 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.419528 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.419532 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.419722 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.420197 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.420202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.420206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.420580 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.420833 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.421146 (+ 313us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.421315 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192837, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:47:17.433627 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.420325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48062 (local address 127.13.88.252:40503)
0923 19:47:17.420493 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.420498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.420584 (+ 86us) server_negotiation.cc:407] Connection header received
0923 19:47:17.420758 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.420763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.420832 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.420918 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.421770 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.422629 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.424260 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.424666 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.424766 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.428350 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.428354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.428357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.428383 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.430942 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.431691 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.431697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.431701 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.431824 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.432184 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.432188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.432191 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.432458 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.432601 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.432939 (+ 338us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.433329 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":158,"server-negotiator.queue_time_us":51}
I20260923 19:47:17.433625 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.420381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:48062)
0923 19:47:17.420513 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.420539 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:17.420637 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:17.420962 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:17.420966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:17.421449 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:17.421633 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.421649 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.422746 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.422753 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.424125 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.424141 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.424811 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.424819 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.425073 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.425671 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:17.425688 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:17.428174 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:17.431145 (+ 2971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.431153 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.431159 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.431585 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.431938 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.431943 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.431946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.432069 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.432562 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:17.432567 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:17.432713 (+ 146us) client_negotiation.cc:769] Sending connection context
0923 19:47:17.432847 (+ 134us) client_negotiation.cc:240] Negotiation successful
0923 19:47:17.433197 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":24}
I20260923 19:47:17.438205 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.423163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38338 (local address 127.13.88.253:40819)
0923 19:47:17.423324 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.423328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.423343 (+ 15us) server_negotiation.cc:407] Connection header received
0923 19:47:17.423480 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.423484 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.423547 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.423618 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.425045 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.425746 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.427419 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.427911 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.428007 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.432449 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.432454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.432458 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.432492 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.435513 (+ 3021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.436168 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.436174 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.436178 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.436339 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.436790 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.436795 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.436798 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.437168 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.437437 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.437619 (+ 182us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.437868 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 19:47:17.440407 3788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: Bootstrap starting.
I20260923 19:47:17.443207 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:17.444222 3788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:17.445350 3788 log.cc:824] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:17.448274 3788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: No bootstrap required, opened a new log
I20260923 19:47:17.445719 3613 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "42d62e88d47346b6937f9b2dca2e91a5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40494
I20260923 19:47:17.455601 3788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
I20260923 19:47:17.455951 3788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f4a5083e3254a4e872be3b5e81763cc, State: Initialized, Role: FOLLOWER
I20260923 19:47:17.456382 3788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
I20260923 19:47:17.457343 3795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.457719 3795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:17.458449 3788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:17.467356 3638 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 4
W20260923 19:47:17.468624 3806 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:47:17.468752 3806 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:47:17.466200 3719 master_runner.cc:186] Error getting master registration for 127.13.88.254:43885: OK, instance_id { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" instance_seqno: 1790192836309384 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:47:17.477807 3719 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
I20260923 19:47:17.490549 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.475466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48078 (local address 127.13.88.252:40503)
0923 19:47:17.475653 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.475659 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.475754 (+ 95us) server_negotiation.cc:407] Connection header received
0923 19:47:17.475949 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.475958 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.476017 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.476129 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.477191 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.478130 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.479917 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.480427 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.480581 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.484643 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.484653 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.484657 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.484700 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.487956 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.488552 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.488560 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.488564 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.488680 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.489064 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.489068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.489071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.489403 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.489545 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.489923 (+ 378us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.490129 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:47:17.490572 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.475432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:48078)
0923 19:47:17.475652 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.475673 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:17.475814 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:17.476153 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:17.476158 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:17.476752 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:17.477051 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.477062 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.478292 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.478297 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.479770 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.479794 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.480624 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.480630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.480804 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.481517 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:17.481540 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:17.484465 (+ 2925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:17.488092 (+ 3627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.488099 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.488104 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.488438 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.488793 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.488797 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.488801 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.488957 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.489514 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:17.489518 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:17.489674 (+ 156us) client_negotiation.cc:769] Sending connection context
0923 19:47:17.489804 (+ 130us) client_negotiation.cc:240] Negotiation successful
0923 19:47:17.490082 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260923 19:47:17.496780 3638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5: Bootstrap starting.
I20260923 19:47:17.500909 3638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:17.502214 3638 log.cc:824] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:17.506054 3638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5: No bootstrap required, opened a new log
I20260923 19:47:17.514021 3638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
I20260923 19:47:17.514459 3638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d62e88d47346b6937f9b2dca2e91a5, State: Initialized, Role: FOLLOWER
I20260923 19:47:17.514955 3638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
I20260923 19:47:17.515950 3809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.516366 3809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:17.517246 3638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:17.517346 3613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 19:47:17.517527 3613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:17.521719 3613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
I20260923 19:47:17.524827 3613 leader_election.cc:288] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [CANDIDATE]: Term 1 election: Requested vote from peers 53a84307d96248e39e646cc6154c38ae (127.13.88.253:40819), 6f4a5083e3254a4e872be3b5e81763cc (127.13.88.252:40503)
I20260923 19:47:17.526062 3763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "42d62e88d47346b6937f9b2dca2e91a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6f4a5083e3254a4e872be3b5e81763cc"
I20260923 19:47:17.526595 3763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:17.530972 3763 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d62e88d47346b6937f9b2dca2e91a5 in term 1.
I20260923 19:47:17.532248 3590 leader_election.cc:302] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d62e88d47346b6937f9b2dca2e91a5, 6f4a5083e3254a4e872be3b5e81763cc; no voters:
I20260923 19:47:17.532815 3809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:17.548869 3809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [term 1 LEADER]: Becoming Leader. State: Replica: 42d62e88d47346b6937f9b2dca2e91a5, State: Running, Role: LEADER
W20260923 19:47:17.549252 3592 tablet.cc:2369] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:47:17.549552 3809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
W20260923 19:47:17.551900 3820 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260923 19:47:17.555167 3712 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } attempt: 5
W20260923 19:47:17.568408 3820 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:47:17.571612 3823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42d62e88d47346b6937f9b2dca2e91a5. Latest consensus state: current_term: 1 leader_uuid: "42d62e88d47346b6937f9b2dca2e91a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.572147 3823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:17.535166 3571 master_runner.cc:186] Error getting master registration for 127.13.88.253:40819: OK, instance_id { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" instance_seqno: 1790192836816521 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:47:17.586346 3571 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:47:17.586472 3832 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 23 19:47:17 dist-test-slave-xg7f krb5kdc[3558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192836, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
I20260923 19:47:17.588800 3832 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:17.596414 3721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.555804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:40503 (local address 127.0.0.1:48094)
0923 19:47:17.556180 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:17.556202 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:17.556356 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:17.571309 (+ 14953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:17.571317 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:17.572027 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:17.572405 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.572421 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.583207 (+ 10786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.583214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.584717 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:17.584736 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.585747 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.585753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:17.585952 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.586668 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:17.586703 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:17.589488 (+ 2785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:17.593618 (+ 4130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.593623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.593627 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.594099 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.594576 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:17.594580 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:17.594584 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:17.594764 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:17.595477 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:17.595483 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:17.595633 (+ 150us) client_negotiation.cc:769] Sending connection context
0923 19:47:17.595762 (+ 129us) client_negotiation.cc:240] Negotiation successful
0923 19:47:17.596034 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196}
I20260923 19:47:17.597575 3830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.556672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48094 (local address 127.13.88.252:40503)
0923 19:47:17.568406 (+ 11734us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.568413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.568439 (+ 26us) server_negotiation.cc:407] Connection header received
0923 19:47:17.568491 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.568496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.568562 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.572606 (+ 4044us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.572911 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.574549 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.584918 (+ 10369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.585572 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.585709 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.589747 (+ 4038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.589754 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.589759 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.589803 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.593474 (+ 3671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.594249 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.594254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.594256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.594447 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.594919 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.594923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.594925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.595303 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.596804 (+ 1501us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.596933 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.597149 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11582,"thread_start_us":22480,"threads_started":1}
I20260923 19:47:17.603456 3712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae: Bootstrap starting.
W20260923 19:47:17.606006 3742 tablet.cc:2369] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:47:17.608512 3712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:17.609856 3712 log.cc:824] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:17.615419 3763 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [term 1 FOLLOWER]: Refusing update from remote peer 42d62e88d47346b6937f9b2dca2e91a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:47:17.616873 3809 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:47:17.632817 3791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.555632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.13.88.252:40503)
0923 19:47:17.555870 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.555878 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.567656 (+ 11778us) server_negotiation.cc:407] Connection header received
0923 19:47:17.567867 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.567876 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.568080 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.568223 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.582872 (+ 14649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.584300 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.590904 (+ 6604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.591618 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.591723 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.613077 (+ 21354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.613084 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.613089 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.613136 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.617411 (+ 4275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.626462 (+ 9051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.626468 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.626473 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.626643 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.628192 (+ 1549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.628198 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.628201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.628588 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.628825 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.631691 (+ 2866us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.632153 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260923 19:47:17.634364 3792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.563759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40510 (local address 127.13.88.254:43885)
0923 19:47:17.564019 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.564028 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.564057 (+ 29us) server_negotiation.cc:407] Connection header received
0923 19:47:17.564143 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.564152 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.564281 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.564424 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.582006 (+ 17582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.583297 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.594815 (+ 11518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.595540 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.595636 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.618052 (+ 22416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.618060 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.618065 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.618109 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.622265 (+ 4156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.625964 (+ 3699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.625971 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.625975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.626136 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.628952 (+ 2816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.628957 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.628961 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.629370 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.629664 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.633550 (+ 3886us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.633826 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260923 19:47:17.648186 3712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae: No bootstrap required, opened a new log
I20260923 19:47:17.649003 3717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:17.568234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.13.88.253:40819)
0923 19:47:17.568413 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.568421 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.577771 (+ 9350us) server_negotiation.cc:407] Connection header received
0923 19:47:17.578123 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.578130 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.578209 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.578276 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.597402 (+ 19126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.598539 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.610026 (+ 11487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:17.610868 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:17.610983 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:17.640294 (+ 29311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:17.640302 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:17.640308 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:17.640353 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:17.644236 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.645670 (+ 1434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.645677 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.645680 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.645839 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:17.646494 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:17.646499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:17.646504 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:17.646909 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:17.647185 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:17.648022 (+ 837us) server_negotiation.cc:299] Negotiation successful
0923 19:47:17.648398 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:47:17.659912 3712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
I20260923 19:47:17.660379 3712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a84307d96248e39e646cc6154c38ae, State: Initialized, Role: FOLLOWER
I20260923 19:47:17.660996 3712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } }
I20260923 19:47:17.661018 3795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42d62e88d47346b6937f9b2dca2e91a5. Latest consensus state: current_term: 1 leader_uuid: "42d62e88d47346b6937f9b2dca2e91a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.661329 3795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:17.674500 3838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.674968 3838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:17.675977 3712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:17.677743 3686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:17.681649 3687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "42d62e88d47346b6937f9b2dca2e91a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "53a84307d96248e39e646cc6154c38ae"
I20260923 19:47:17.683585 3686 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [term 1 FOLLOWER]: Refusing update from remote peer 42d62e88d47346b6937f9b2dca2e91a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:47:17.687475 3687 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d62e88d47346b6937f9b2dca2e91a5 in term 1.
I20260923 19:47:17.688846 3833 mvcc.cc:205] Tried to move back new op lower bound from 7332629862861733888 to 7332629862608658432. Current Snapshot: MvccSnapshot[applied={T|T < 7332629862861733888}]
I20260923 19:47:17.689374 3823 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:47:17.690943 3835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "42d62e88d47346b6937f9b2dca2e91a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.691349 3835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:17.691859 3836 mvcc.cc:205] Tried to move back new op lower bound from 7332629862861733888 to 7332629862608658432. Current Snapshot: MvccSnapshot[applied={T|T < 7332629862861733888}]
I20260923 19:47:17.700405 3832 catalog_manager.cc:1347] Generated new cluster ID: 55aa045784384a07893d88af7342c19d
I20260923 19:47:17.700531 3832 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:17.712842 3795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "42d62e88d47346b6937f9b2dca2e91a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.713112 3795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:17.723353 3823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "42d62e88d47346b6937f9b2dca2e91a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.723727 3823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:17.724454 3838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42d62e88d47346b6937f9b2dca2e91a5. Latest consensus state: current_term: 1 leader_uuid: "42d62e88d47346b6937f9b2dca2e91a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.724794 3838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:17.725103 3851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "42d62e88d47346b6937f9b2dca2e91a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d62e88d47346b6937f9b2dca2e91a5" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43885 } } peers { permanent_uuid: "53a84307d96248e39e646cc6154c38ae" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 40819 } } peers { permanent_uuid: "6f4a5083e3254a4e872be3b5e81763cc" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 40503 } } }
I20260923 19:47:17.725518 3851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:17.726372 3832 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:17.736639 3832 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:17.756671 3856 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:47:17.769745 3832 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42d62e88d47346b6937f9b2dca2e91a5: Generated new TSK 0
I20260923 19:47:17.770905 3832 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 19:47:17.862404 3792 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.854097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40516 (local address 127.13.88.254:43885)
0923 19:47:17.854310 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.854318 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.858689 (+ 4371us) server_negotiation.cc:407] Connection header received
0923 19:47:17.859794 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.859802 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.859896 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.859977 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.862132 (+ 2155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40516: BlockingRecv error: recv got EOF from 127.0.0.1:40516 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260923 19:47:17.865031 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.858879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38350 (local address 127.13.88.253:40819)
0923 19:47:17.859088 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.859097 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.863373 (+ 4276us) server_negotiation.cc:407] Connection header received
0923 19:47:17.863625 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.863631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.863714 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.863785 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.864769 (+ 984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38350: BlockingRecv error: recv got EOF from 127.0.0.1:38350 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260923 19:47:17.867333 3791 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.855063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48102 (local address 127.13.88.252:40503)
0923 19:47:17.855320 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.855328 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.862627 (+ 7299us) server_negotiation.cc:407] Connection header received
0923 19:47:17.865672 (+ 3045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.865678 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.865772 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.865854 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.867015 (+ 1161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48102: BlockingRecv error: recv got EOF from 127.0.0.1:48102 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
W20260923 19:47:17.875205 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.872965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38356 (local address 127.13.88.253:40819)
0923 19:47:17.873132 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.873138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.873668 (+ 530us) server_negotiation.cc:407] Connection header received
0923 19:47:17.873934 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.873939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.874058 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.874157 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.874909 (+ 752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38356: BlockingRecv error: recv got EOF from 127.0.0.1:38356 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260923 19:47:17.883308 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.881155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38360 (local address 127.13.88.253:40819)
0923 19:47:17.881322 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.881328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.881846 (+ 518us) server_negotiation.cc:407] Connection header received
0923 19:47:17.882116 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.882122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.882218 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.882330 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.883067 (+ 737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38360: BlockingRecv error: recv got EOF from 127.0.0.1:38360 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260923 19:47:17.893152 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.890968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38376 (local address 127.13.88.253:40819)
0923 19:47:17.891164 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.891170 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.891671 (+ 501us) server_negotiation.cc:407] Connection header received
0923 19:47:17.891858 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.891864 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.891970 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.892101 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.892903 (+ 802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38376: BlockingRecv error: recv got EOF from 127.0.0.1:38376 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260923 19:47:17.907491 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.905129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38390 (local address 127.13.88.253:40819)
0923 19:47:17.905351 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.905358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.905882 (+ 524us) server_negotiation.cc:407] Connection header received
0923 19:47:17.906102 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.906110 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.906218 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.906338 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.907251 (+ 913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38390: BlockingRecv error: recv got EOF from 127.0.0.1:38390 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
W20260923 19:47:17.921455 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.919131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38400 (local address 127.13.88.253:40819)
0923 19:47:17.919307 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.919313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.919841 (+ 528us) server_negotiation.cc:407] Connection header received
0923 19:47:17.920057 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.920063 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.920170 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.920290 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.921204 (+ 914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38400: BlockingRecv error: recv got EOF from 127.0.0.1:38400 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260923 19:47:17.945786 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.943513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38416 (local address 127.13.88.253:40819)
0923 19:47:17.943684 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.943690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.944210 (+ 520us) server_negotiation.cc:407] Connection header received
0923 19:47:17.944410 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.944416 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.944524 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.944642 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.945533 (+ 891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38416: BlockingRecv error: recv got EOF from 127.0.0.1:38416 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260923 19:47:17.984407 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:17.981973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38432 (local address 127.13.88.253:40819)
0923 19:47:17.982156 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:17.982162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:17.982830 (+ 668us) server_negotiation.cc:407] Connection header received
0923 19:47:17.983062 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:17.983068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:17.983188 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:17.983308 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:17.984137 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38432: BlockingRecv error: recv got EOF from 127.0.0.1:38432 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260923 19:47:18.055264 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:18.053216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38444 (local address 127.13.88.253:40819)
0923 19:47:18.053465 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:18.053471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:18.053734 (+ 263us) server_negotiation.cc:407] Connection header received
0923 19:47:18.053995 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:18.054015 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:18.054111 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:18.054220 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:18.055032 (+ 812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38444: BlockingRecv error: recv got EOF from 127.0.0.1:38444 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260923 19:47:18.190688 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:18.188926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38452 (local address 127.13.88.253:40819)
0923 19:47:18.189115 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:18.189120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:18.189484 (+ 364us) server_negotiation.cc:407] Connection header received
0923 19:47:18.189638 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:18.189642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:18.189716 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:18.189838 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:18.190499 (+ 661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38452: BlockingRecv error: recv got EOF from 127.0.0.1:38452 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260923 19:47:18.454603 3717 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:18.452881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38458 (local address 127.13.88.253:40819)
0923 19:47:18.453056 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:18.453061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:18.453355 (+ 294us) server_negotiation.cc:407] Connection header received
0923 19:47:18.453568 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:18.453573 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:18.453645 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:18.453736 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:18.454360 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38458: BlockingRecv error: recv got EOF from 127.0.0.1:38458 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:47:18.470700 3806 catalog_manager.cc:1259] Loaded cluster ID: 55aa045784384a07893d88af7342c19d
I20260923 19:47:18.470803 3806 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: loading cluster ID for follower catalog manager: success
I20260923 19:47:18.473346 3806 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: acquiring CA information for follower catalog manager: success
I20260923 19:47:18.475199 3806 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6f4a5083e3254a4e872be3b5e81763cc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:47:18.761224 3856 catalog_manager.cc:1259] Loaded cluster ID: 55aa045784384a07893d88af7342c19d
I20260923 19:47:18.761435 3856 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae: loading cluster ID for follower catalog manager: success
I20260923 19:47:18.764047 3856 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae: acquiring CA information for follower catalog manager: success
I20260923 19:47:18.765920 3856 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 53a84307d96248e39e646cc6154c38ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:47:18.981853 3922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:18.974593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38472 (local address 127.13.88.253:40819)
0923 19:47:18.975473 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:18.975478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:18.975494 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:47:18.975558 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:18.975561 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:18.975694 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:18.975794 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:18.976273 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:18.977188 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:18.979206 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:18.979648 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:18.979739 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:18.980417 (+ 678us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:18.981100 (+ 683us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:18.981237 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:18.981359 (+ 122us) server_negotiation.cc:299] Negotiation successful
0923 19:47:18.981447 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":609,"threads_started":1}
I20260923 19:47:18.998437 3928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:18.992545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48116 (local address 127.13.88.252:40503)
0923 19:47:18.993273 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:18.993279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:18.993297 (+ 18us) server_negotiation.cc:407] Connection header received
0923 19:47:18.993395 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:18.993399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:18.993551 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:18.993725 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:18.994148 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:18.994870 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:18.996218 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:18.996625 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:18.996752 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:18.997247 (+ 495us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:18.997798 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:18.997958 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:18.998039 (+ 81us) server_negotiation.cc:299] Negotiation successful
0923 19:47:18.998127 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":440,"threads_started":1}
I20260923 19:47:19.017097 3934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:19.004927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40518 (local address 127.13.88.254:43885)
0923 19:47:19.008715 (+ 3788us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:19.008725 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:19.009232 (+ 507us) server_negotiation.cc:407] Connection header received
0923 19:47:19.009372 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:19.009378 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:19.009616 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:19.010394 (+ 778us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:19.010590 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:19.011715 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:19.013992 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:19.014628 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:19.015307 (+ 679us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:19.015517 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:19.015985 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:19.016588 (+ 603us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:19.016643 (+ 55us) server_negotiation.cc:299] Negotiation successful
0923 19:47:19.016733 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3626,"thread_start_us":3487,"threads_started":1}
I20260923 19:47:19.021553 3928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:19.005072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48120 (local address 127.13.88.252:40503)
0923 19:47:19.005243 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:19.005250 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:19.012927 (+ 7677us) server_negotiation.cc:407] Connection header received
0923 19:47:19.013319 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:19.013325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:19.013440 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:19.013521 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:19.014367 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:19.015482 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:19.019231 (+ 3749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:19.019872 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:19.020022 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:19.020685 (+ 663us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:19.020826 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:19.020896 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:19.021138 (+ 242us) server_negotiation.cc:299] Negotiation successful
0923 19:47:19.021253 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:47:19.021687 3922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:19.009337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38474 (local address 127.13.88.253:40819)
0923 19:47:19.009574 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:19.009583 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:19.013214 (+ 3631us) server_negotiation.cc:407] Connection header received
0923 19:47:19.013479 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:19.013487 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:19.013585 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:19.013646 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:19.014424 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:19.015597 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:19.018004 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:19.018730 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:19.018872 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:19.020751 (+ 1879us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:19.020899 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:19.020980 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:19.021265 (+ 285us) server_negotiation.cc:299] Negotiation successful
0923 19:47:19.021351 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 19:47:19.022411 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3571
I20260923 19:47:19.023984 3633 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:19.161854 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3571
I20260923 19:47:19.182619 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3645
I20260923 19:47:19.183806 3707 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:19.290164 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3645
I20260923 19:47:19.310729 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3719
I20260923 19:47:19.311874 3783 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:19.418473 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3719
2026-09-23T19:47:19Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4877 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 19:47:19 dist-test-slave-xg7f krb5kdc[3942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 19:47:19 dist-test-slave-xg7f krb5kdc[3942](info): set up 2 sockets
Sep 23 19:47:19 dist-test-slave-xg7f krb5kdc[3942](info): commencing operation
krb5kdc: starting...
W20260923 19:47:20.527685 13667 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/test-user.keytab.
Sep 23 19:47:20 dist-test-slave-xg7f krb5kdc[3942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T19:47:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:47:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.13.88.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
Entry for principal kudu/127.13.88.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab.
I20260923 19:47:20.789608 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43067
--webserver_interface=127.13.88.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43067,127.13.88.253:35363,127.13.88.252:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 19:47:21.117733 3955 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:47:21.118058 3955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:21.118130 3955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:21.118212 3955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:21.125471 3955 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:21.125571 3955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:21.125625 3955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:21.125677 3955 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:21.125736 3955 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:21.135728 3955 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43067,127.13.88.253:35363,127.13.88.252:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.254.keytab
--principal=kudu/127.13.88.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.254:43067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.88.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:21.137014 3955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:21.138307 3955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:21.149784 3960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:21.149863 3961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:21.149824 3963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:21.150997 3955 server_base.cc:1034] running on GCE node
I20260923 19:47:21.151815 3955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:21.153189 3955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:21.154417 3955 hybrid_clock.cc:648] HybridClock initialized: now 1790192841154350 us; error 32 us; skew 500 ppm
I20260923 19:47:21.154808 3955 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:21 dist-test-slave-xg7f krb5kdc[3942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:21.157950 3955 init.cc:377] Logged in from keytab as kudu/127.13.88.254@KRBTEST.COM (short username kudu)
I20260923 19:47:21.159523 3955 webserver.cc:460] Webserver started at http://127.13.88.254:45791/ using document root <none> and password file <none>
I20260923 19:47:21.160188 3955 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:21.160320 3955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:21.160790 3955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:21.163890 3955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data/instance:
uuid: "f04fbffee65642169e9b77925286dbc7"
format_stamp: "Formatted at 2026-09-23 19:47:21 on dist-test-slave-xg7f"
server_key: "73dd6dab08dc1bef3de441f4c2bbde14"
server_key_iv: "7130795f9472317d00a4943d0c96db45"
server_key_version: "encryptionkey@0"
I20260923 19:47:21.164695 3955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/wal/instance:
uuid: "f04fbffee65642169e9b77925286dbc7"
format_stamp: "Formatted at 2026-09-23 19:47:21 on dist-test-slave-xg7f"
server_key: "73dd6dab08dc1bef3de441f4c2bbde14"
server_key_iv: "7130795f9472317d00a4943d0c96db45"
server_key_version: "encryptionkey@0"
I20260923 19:47:21.169771 3955 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:47:21.173295 3970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:21.174635 3955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 19:47:21.174832 3955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/wal
uuid: "f04fbffee65642169e9b77925286dbc7"
format_stamp: "Formatted at 2026-09-23 19:47:21 on dist-test-slave-xg7f"
server_key: "73dd6dab08dc1bef3de441f4c2bbde14"
server_key_iv: "7130795f9472317d00a4943d0c96db45"
server_key_version: "encryptionkey@0"
I20260923 19:47:21.175050 3955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:21.198547 3955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:21.203195 3955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:21.203478 3955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:21.222548 3955 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.254:43067
I20260923 19:47:21.222569 4021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.254:43067 every 8 connection(s)
I20260923 19:47:21.223917 3955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/data/info.pb
I20260923 19:47:21.224241 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 3955
I20260923 19:47:21.224393 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-0/wal/instance
I20260923 19:47:21.224846 13667 external_mini_cluster.cc:1428] Setting key 59f7478122f631c517ce6bdee891f43e
I20260923 19:47:21.227744 4022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:21.234184 4022 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.13.88.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.253@KRBTEST.COM" created.
Sep 23 19:47:21 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:47:21.260551 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.237446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43067 (local address 127.0.0.1:40592)
0923 19:47:21.238433 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.238502 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:21.240449 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:21.241414 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:21.241423 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:21.241965 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:21.242313 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.242329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.244692 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.244696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.245683 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.245693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.246994 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.246999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.247179 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.247823 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:21.247845 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:21.251920 (+ 4075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:21.256065 (+ 4145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.256075 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.256085 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.256456 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.256890 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.256893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.256896 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.257043 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.258016 (+ 973us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:21.258026 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:21.258269 (+ 243us) client_negotiation.cc:769] Sending connection context
0923 19:47:21.258530 (+ 261us) client_negotiation.cc:240] Negotiation successful
0923 19:47:21.259251 (+ 721us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":191,"thread_start_us":376,"threads_started":1}
I20260923 19:47:21.260589 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.237446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40592 (local address 127.13.88.254:43067)
0923 19:47:21.239093 (+ 1647us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:21.239124 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:21.239176 (+ 52us) server_negotiation.cc:407] Connection header received
0923 19:47:21.240821 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:21.240832 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:21.241170 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:21.241387 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:21.242522 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.244537 (+ 2015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.245841 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.246759 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.246985 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.252177 (+ 5192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:21.252190 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:21.252210 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:21.252271 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:21.255942 (+ 3671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.256581 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.256591 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.256597 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.256785 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.257143 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.257150 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.257155 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.257865 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:21.258079 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:21.258692 (+ 613us) server_negotiation.cc:299] Negotiation successful
0923 19:47:21.259049 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1433,"spinlock_wait_cycles":36608,"thread_start_us":1226,"threads_started":1}
I20260923 19:47:21.263722 4022 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:47:21.264959 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.264449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:57940)
0923 19:47:21.264661 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.264800 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260923 19:47:21.265261 3973 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
I20260923 19:47:21.266913 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.266457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:57948)
0923 19:47:21.266640 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.266730 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260923 19:47:21.267153 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:35363: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab.
Entry for principal kudu/127.13.88.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab.
I20260923 19:47:21.283478 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:35363
--webserver_interface=127.13.88.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab
--principal=kudu/127.13.88.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43067,127.13.88.253:35363,127.13.88.252:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:47:21.316563 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } attempt: 1
I20260923 19:47:21.317746 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.317273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:57960)
0923 19:47:21.317478 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.317615 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260923 19:47:21.318781 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.318430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:57966)
0923 19:47:21.318590 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.318654 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 19:47:21.318961 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:35363: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
I20260923 19:47:21.387207 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } attempt: 2
I20260923 19:47:21.388329 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.387848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36592)
0923 19:47:21.388100 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.388189 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260923 19:47:21.389415 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.388940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36608)
0923 19:47:21.389109 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.389287 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 19:47:21.389590 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:35363: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
I20260923 19:47:21.480821 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } attempt: 3
I20260923 19:47:21.481907 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.481474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36614)
0923 19:47:21.481683 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.481777 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260923 19:47:21.483217 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.482663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36624)
0923 19:47:21.482869 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.483003 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260923 19:47:21.483439 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:35363: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
W20260923 19:47:21.609443 4029 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:47:21.609800 4029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:21.609926 4029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:21.610066 4029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:21.617324 4029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:21.617415 4029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:21.617506 4029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:21.617587 4029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:21.617691 4029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:21.626806 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } attempt: 4
I20260923 19:47:21.627802 4029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43067,127.13.88.253:35363,127.13.88.252:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.253.keytab
--principal=kudu/127.13.88.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.253:35363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.13.88.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:21.628170 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.627520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36628)
0923 19:47:21.627889 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.628004 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260923 19:47:21.629205 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.628797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36638)
0923 19:47:21.628954 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.629055 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 19:47:21.629393 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.253:35363: Network error: Client connection negotiation failed: client connection to 127.13.88.253:35363: connect: Connection refused (error 111)
I20260923 19:47:21.629629 4029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:21.630942 4029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 19:47:21.642509 4034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:21.642568 4037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:21.642594 4035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:21.643422 4029 server_base.cc:1034] running on GCE node
I20260923 19:47:21.644207 4029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:21.645681 4029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:21.646911 4029 hybrid_clock.cc:648] HybridClock initialized: now 1790192841646813 us; error 51 us; skew 500 ppm
I20260923 19:47:21.647279 4029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:21 dist-test-slave-xg7f krb5kdc[3942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:21.650179 4029 init.cc:377] Logged in from keytab as kudu/127.13.88.253@KRBTEST.COM (short username kudu)
I20260923 19:47:21.651674 4029 webserver.cc:460] Webserver started at http://127.13.88.253:34533/ using document root <none> and password file <none>
I20260923 19:47:21.652333 4029 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:21.652458 4029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:21.652766 4029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:21.655758 4029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data/instance:
uuid: "98e63066ab3e4633a47fa49230ce6639"
format_stamp: "Formatted at 2026-09-23 19:47:21 on dist-test-slave-xg7f"
server_key: "cddd95f7b467ea98280f6edfd19678a1"
server_key_iv: "10d36a853886db561d57bed6113b0a82"
server_key_version: "encryptionkey@0"
I20260923 19:47:21.656545 4029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/wal/instance:
uuid: "98e63066ab3e4633a47fa49230ce6639"
format_stamp: "Formatted at 2026-09-23 19:47:21 on dist-test-slave-xg7f"
server_key: "cddd95f7b467ea98280f6edfd19678a1"
server_key_iv: "10d36a853886db561d57bed6113b0a82"
server_key_version: "encryptionkey@0"
I20260923 19:47:21.661516 4029 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260923 19:47:21.666824 4044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:21.669411 4029 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.002s
I20260923 19:47:21.669747 4029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/wal
uuid: "98e63066ab3e4633a47fa49230ce6639"
format_stamp: "Formatted at 2026-09-23 19:47:21 on dist-test-slave-xg7f"
server_key: "cddd95f7b467ea98280f6edfd19678a1"
server_key_iv: "10d36a853886db561d57bed6113b0a82"
server_key_version: "encryptionkey@0"
I20260923 19:47:21.670131 4029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:21.696928 4029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:21.701323 4029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:21.701596 4029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:21.719666 4029 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.253:35363
I20260923 19:47:21.719686 4095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.253:35363 every 8 connection(s)
I20260923 19:47:21.721009 4029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/data/info.pb
I20260923 19:47:21.724671 4096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:21.728529 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 4029
I20260923 19:47:21.728717 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-1/wal/instance
I20260923 19:47:21.729143 13667 external_mini_cluster.cc:1428] Setting key e7f7bfdd9e4dc0b2022544f5fbbc528b
I20260923 19:47:21.731963 4096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:21 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.13.88.252@KRBTEST.COM; defaulting to no policy
I20260923 19:47:21.752821 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.734616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59084 (local address 127.13.88.254:43067)
0923 19:47:21.734839 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:21.734846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:21.736030 (+ 1184us) server_negotiation.cc:407] Connection header received
0923 19:47:21.737911 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:21.737916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:21.738009 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:21.738122 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:21.739669 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.740372 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.741861 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.742295 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.742422 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.745944 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:21.745953 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:21.745961 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:21.746008 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:21.749749 (+ 3741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.750515 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.750522 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.750525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.750671 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.751068 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.751076 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.751082 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.751536 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:21.751688 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:21.752389 (+ 701us) server_negotiation.cc:299] Negotiation successful
0923 19:47:21.752559 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 19:47:21.753928 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.735002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43067 (local address 127.0.0.1:59084)
0923 19:47:21.735853 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.735900 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:21.737645 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:21.738349 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:21.738357 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:21.738894 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:21.739491 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.739506 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.740536 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.740540 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.741714 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.741725 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.742520 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.742527 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.742747 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.743497 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:21.743519 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:21.745704 (+ 2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:21.749881 (+ 4177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.749887 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.749899 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.750367 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.750776 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.750779 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.750781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.750942 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.751657 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:21.751663 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:21.752029 (+ 366us) client_negotiation.cc:769] Sending connection context
0923 19:47:21.752257 (+ 228us) client_negotiation.cc:240] Negotiation successful
0923 19:47:21.752634 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":338,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.13.88.252@KRBTEST.COM" created.
I20260923 19:47:21.755800 4096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:21 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:47:21.771631 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.756612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36652)
0923 19:47:21.756784 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.756801 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:21.756889 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:21.757972 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:21.757980 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:21.758459 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:21.758667 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.758680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.760509 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.760517 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.762040 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.762056 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.763157 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.763163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.763361 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.763948 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:21.763965 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:21.766163 (+ 2198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:21.769226 (+ 3063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.769233 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.769236 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.769565 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.769911 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.769917 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.769920 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.770056 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.770637 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:21.770641 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:21.770783 (+ 142us) client_negotiation.cc:769] Sending connection context
0923 19:47:21.770929 (+ 146us) client_negotiation.cc:240] Negotiation successful
0923 19:47:21.771238 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 19:47:21.771734 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.756846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36652 (local address 127.13.88.253:35363)
0923 19:47:21.757472 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:21.757478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:21.757501 (+ 23us) server_negotiation.cc:407] Connection header received
0923 19:47:21.757571 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:21.757582 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:21.757798 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:21.757930 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:21.758837 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.760365 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.762184 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.762983 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.763144 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.766352 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:21.766362 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:21.766393 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:21.766423 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:21.769092 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.769691 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.769699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.769702 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.769812 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.770154 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.770162 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.770165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.770516 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:21.770733 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:21.771080 (+ 347us) server_negotiation.cc:299] Negotiation successful
0923 19:47:21.771352 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":489,"thread_start_us":330,"threads_started":1}
I20260923 19:47:21.774209 4096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:47:21.775378 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.774882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45538)
0923 19:47:21.775066 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.775233 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:47:21.775614 4047 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
I20260923 19:47:21.777390 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.777073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45554)
0923 19:47:21.777208 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.777290 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 19:47:21.777616 4096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.13.88.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab.
Entry for principal kudu/127.13.88.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab.
I20260923 19:47:21.785702 13667 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
/tmp/dist-test-taskZLYS4k/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:46011
--webserver_interface=127.13.88.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab
--principal=kudu/127.13.88.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.13.88.212:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.88.254:43067,127.13.88.253:35363,127.13.88.252:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 19:47:21.826920 4096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 1
I20260923 19:47:21.828156 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.827573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45568)
0923 19:47:21.827807 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.827962 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260923 19:47:21.829149 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.828778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45576)
0923 19:47:21.828937 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.829024 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260923 19:47:21.829342 4096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
I20260923 19:47:21.897594 4096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 2
I20260923 19:47:21.898813 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.898296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45588)
0923 19:47:21.898518 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.898628 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260923 19:47:21.899809 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.899469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45598)
0923 19:47:21.899604 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.899681 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 19:47:21.900053 4096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
I20260923 19:47:21.928628 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } attempt: 5
Sep 23 19:47:21 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:47:21.942085 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.929465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36654 (local address 127.13.88.253:35363)
0923 19:47:21.929653 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:21.929659 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:21.929767 (+ 108us) server_negotiation.cc:407] Connection header received
0923 19:47:21.929983 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:21.929992 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:21.930071 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:21.930184 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:21.930978 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.931751 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.932880 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.933328 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.933464 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.937023 (+ 3559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:21.937028 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:21.937031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:21.937062 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:21.939621 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.940216 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.940223 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.940226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.940344 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:21.940699 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:21.940704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:21.940708 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:21.940984 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:21.941129 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:21.941527 (+ 398us) server_negotiation.cc:299] Negotiation successful
0923 19:47:21.941749 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 19:47:21.942092 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.929423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36654)
0923 19:47:21.929653 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.929675 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:21.929843 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:21.930228 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:21.930235 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:21.930650 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:21.930825 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.930834 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.931887 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.931893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.932732 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:21.932750 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:21.933477 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:21.933482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:21.933685 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:21.934337 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:21.934355 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:21.936831 (+ 2476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:21.939740 (+ 2909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.939746 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.939750 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.940109 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.940455 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:21.940460 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:21.940464 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:21.940596 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:21.941094 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:21.941099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:21.941276 (+ 177us) client_negotiation.cc:769] Sending connection context
0923 19:47:21.941414 (+ 138us) client_negotiation.cc:240] Negotiation successful
0923 19:47:21.941727 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260923 19:47:21.943499 4022 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:47:21.944563 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.944134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45602)
0923 19:47:21.944306 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.944397 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260923 19:47:21.945566 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.945191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45610)
0923 19:47:21.945354 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.945446 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 19:47:21.945760 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
I20260923 19:47:21.991293 4096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 3
I20260923 19:47:21.992565 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.991958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45626)
0923 19:47:21.992227 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.992357 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260923 19:47:21.993690 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.993243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45638)
0923 19:47:21.993470 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.993562 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260923 19:47:21.993917 4096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
I20260923 19:47:21.997002 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 1
I20260923 19:47:21.998102 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.997634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45652)
0923 19:47:21.997824 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.997932 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260923 19:47:21.999197 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:21.998810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45664)
0923 19:47:21.998970 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:21.999053 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:47:21.999444 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
I20260923 19:47:22.067692 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 2
I20260923 19:47:22.068984 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.068376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45666)
0923 19:47:22.068626 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.068747 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260923 19:47:22.070026 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.069624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45672)
0923 19:47:22.069801 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.069898 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 19:47:22.070243 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
W20260923 19:47:22.111850 4103 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 19:47:22.112167 4103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:47:22.112238 4103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:47:22.112321 4103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 19:47:22.119329 4103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:47:22.119429 4103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 19:47:22.119488 4103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:47:22.119537 4103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:47:22.119601 4103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:47:22.129221 4103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.88.212:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.13.88.254:43067,127.13.88.253:35363,127.13.88.252:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/krb5kdc/kudu_127.13.88.252.keytab
--principal=kudu/127.13.88.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.88.252:46011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.13.88.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 23 Sep 2026 18:36:48 UTC on ccycloud.quasar-figybr.root.comops.site
build id 4668088
ASAN enabled
I20260923 19:47:22.130486 4103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:47:22.131808 4103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 19:47:22.137137 4096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 4
I20260923 19:47:22.138474 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.137802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45674)
0923 19:47:22.138133 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.138266 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260923 19:47:22.139595 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.139232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45682)
0923 19:47:22.139387 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.139469 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 19:47:22.139796 4096 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
W20260923 19:47:22.143806 4109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:22.143847 4111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:47:22.144153 4108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:47:22.144728 4103 server_base.cc:1034] running on GCE node
I20260923 19:47:22.145473 4103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:47:22.146875 4103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:47:22.148111 4103 hybrid_clock.cc:648] HybridClock initialized: now 1790192842148018 us; error 63 us; skew 500 ppm
I20260923 19:47:22.148464 4103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192842, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 19:47:22.152047 4103 init.cc:377] Logged in from keytab as kudu/127.13.88.252@KRBTEST.COM (short username kudu)
I20260923 19:47:22.153465 4103 webserver.cc:460] Webserver started at http://127.13.88.252:34123/ using document root <none> and password file <none>
I20260923 19:47:22.154127 4103 fs_manager.cc:359] Metadata directory not provided
I20260923 19:47:22.154206 4103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:47:22.154466 4103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:47:22.157421 4103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data/instance:
uuid: "a2f12925cdff48649d97eaf0df3a057a"
format_stamp: "Formatted at 2026-09-23 19:47:22 on dist-test-slave-xg7f"
server_key: "312fe676d88391dd066100c65f4038e5"
server_key_iv: "b3eaec4e0180c17221e944a1a27529d2"
server_key_version: "encryptionkey@0"
I20260923 19:47:22.158129 4103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/wal/instance:
uuid: "a2f12925cdff48649d97eaf0df3a057a"
format_stamp: "Formatted at 2026-09-23 19:47:22 on dist-test-slave-xg7f"
server_key: "312fe676d88391dd066100c65f4038e5"
server_key_iv: "b3eaec4e0180c17221e944a1a27529d2"
server_key_version: "encryptionkey@0"
I20260923 19:47:22.163071 4103 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260923 19:47:22.166353 4118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:47:22.167738 4103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:47:22.167899 4103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data,/tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/wal
uuid: "a2f12925cdff48649d97eaf0df3a057a"
format_stamp: "Formatted at 2026-09-23 19:47:22 on dist-test-slave-xg7f"
server_key: "312fe676d88391dd066100c65f4038e5"
server_key_iv: "b3eaec4e0180c17221e944a1a27529d2"
server_key_version: "encryptionkey@0"
I20260923 19:47:22.168098 4103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:47:22.176443 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 3
I20260923 19:47:22.177500 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.177021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45684)
0923 19:47:22.177225 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.177320 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 19:47:22.178484 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.178154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45696)
0923 19:47:22.178298 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.178367 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 19:47:22.178663 4022 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.13.88.252:46011: Network error: Client connection negotiation failed: client connection to 127.13.88.252:46011: connect: Connection refused (error 111)
I20260923 19:47:22.194092 4103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 19:47:22.198446 4103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:47:22.198693 4103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:47:22.217473 4103 rpc_server.cc:307] RPC server started. Bound to: 127.13.88.252:46011
I20260923 19:47:22.217540 4169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.13.88.252:46011 every 8 connection(s)
I20260923 19:47:22.218775 4103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/data/info.pb
I20260923 19:47:22.219949 13667 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu as pid 4103
I20260923 19:47:22.220137 13667 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskZLYS4k/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790192489293654-13667-0/minicluster-data/master-2/wal/instance
I20260923 19:47:22.220543 13667 external_mini_cluster.cc:1428] Setting key 1b05cc5cf2a9bbf72c4b2aec756a12cf
I20260923 19:47:22.223277 4170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:47:22.231369 4170 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192842, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
I20260923 19:47:22.244529 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.222492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45702 (local address 127.13.88.252:46011)
0923 19:47:22.223390 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.223404 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.223449 (+ 45us) server_negotiation.cc:407] Connection header received
0923 19:47:22.225684 (+ 2235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.225711 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.226243 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.226685 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.228378 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.230403 (+ 2025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.232299 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.232983 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.233115 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.237552 (+ 4437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.237561 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.237571 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.237614 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.240700 (+ 3086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.241382 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.241389 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.241394 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.241535 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.241956 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.241959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.241961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.242453 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.242755 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.243218 (+ 463us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.243577 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":487,"threads_started":1}
I20260923 19:47:22.248183 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.234230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.13.88.254:43067)
0923 19:47:22.234424 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.234433 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.235125 (+ 692us) server_negotiation.cc:407] Connection header received
0923 19:47:22.235335 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.235341 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.235432 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.235551 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.236554 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.237321 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.238971 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.239462 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.239585 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.242554 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.242559 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.242562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.242593 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.245346 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.246070 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.246080 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.246083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.246225 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.246594 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.246601 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.246604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.246935 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.247112 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.247721 (+ 609us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.247919 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:47:22.248409 4174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.234240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.254:43067 (local address 127.0.0.1:59090)
0923 19:47:22.234964 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.235009 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:22.235191 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:22.235590 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:22.235595 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:22.236183 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:22.236407 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.236414 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.237530 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.237535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.238813 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.238825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.239656 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.239664 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.239833 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.240378 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:22.240403 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:22.242371 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:22.245468 (+ 3097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.245480 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.245494 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.245950 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.246339 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.246343 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.246347 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.246476 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.247095 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:22.247102 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:22.247287 (+ 185us) client_negotiation.cc:769] Sending connection context
0923 19:47:22.247479 (+ 192us) client_negotiation.cc:240] Negotiation successful
0923 19:47:22.247856 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":363,"threads_started":1}
I20260923 19:47:22.249894 4170 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.254@KRBTEST.COM
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192842, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:47:22.263715 4174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.250729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.253:35363 (local address 127.0.0.1:36670)
0923 19:47:22.250897 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.250916 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:22.251016 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:22.251444 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:22.251449 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:22.251850 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:22.251979 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.251993 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.253289 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.253296 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.254528 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.254544 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.255575 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.255579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.255714 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.256211 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:22.256227 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:22.258379 (+ 2152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:22.261382 (+ 3003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.261387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.261391 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.261731 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.262095 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.262100 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.262105 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.262252 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.262762 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:22.262766 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:22.262911 (+ 145us) client_negotiation.cc:769] Sending connection context
0923 19:47:22.263058 (+ 147us) client_negotiation.cc:240] Negotiation successful
0923 19:47:22.263370 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 19:47:22.263767 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.247475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.13.88.254:43067)
0923 19:47:22.248470 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.248476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.248490 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:47:22.248532 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.248537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.248637 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.248940 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.250439 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.251640 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.253215 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.253852 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.253974 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.258410 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.258419 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.258427 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.258471 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.261227 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.261878 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.261882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.261884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.261999 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.262368 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.262374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.262377 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.262653 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.262908 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.263225 (+ 317us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.263425 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":906,"thread_start_us":3037,"threads_started":1}
I20260923 19:47:22.263790 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.250996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36670 (local address 127.13.88.253:35363)
0923 19:47:22.251195 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.251200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.251216 (+ 16us) server_negotiation.cc:407] Connection header received
0923 19:47:22.251263 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.251266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.251320 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.251396 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.252132 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.253167 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.254683 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.255426 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.255574 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.258547 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.258551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.258554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.258589 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.261241 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.261841 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.261846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.261850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.261982 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.262369 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.262376 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.262379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.262648 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.262789 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.263217 (+ 428us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.263426 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 19:47:22.264835 4170 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192842, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.252@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.13.88.253@KRBTEST.COM
I20260923 19:47:22.278517 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.265530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45708 (local address 127.13.88.252:46011)
0923 19:47:22.265682 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.265687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.265704 (+ 17us) server_negotiation.cc:407] Connection header received
0923 19:47:22.265867 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.265872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.265954 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.266047 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.266650 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.267761 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.269172 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.269771 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.269902 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.272861 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.272868 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.272873 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.272910 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.275833 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.276595 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.276603 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.276608 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.276785 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.277185 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.277188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.277190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.277432 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.277604 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.277998 (+ 394us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.278180 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":62}
I20260923 19:47:22.278770 4174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.265464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45708)
0923 19:47:22.265662 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.265675 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:22.265742 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:22.266068 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:22.266071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:22.266391 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:22.266515 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.266522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.267882 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.267886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.269057 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.269067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.269904 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.269908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.270059 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.270596 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:22.270619 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:22.272672 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:22.275950 (+ 3278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.275954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.275958 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.276493 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.276908 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.276913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.276916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.277087 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.277571 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:22.277574 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:22.277760 (+ 186us) client_negotiation.cc:769] Sending connection context
0923 19:47:22.277923 (+ 163us) client_negotiation.cc:240] Negotiation successful
0923 19:47:22.278368 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":110}
I20260923 19:47:22.281724 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.265513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36682 (local address 127.13.88.253:35363)
0923 19:47:22.265925 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.265943 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.265957 (+ 14us) server_negotiation.cc:407] Connection header received
0923 19:47:22.265999 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.266003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.266077 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.266175 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.267721 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.268727 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.270235 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.270863 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.271002 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.275793 (+ 4791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.275797 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.275800 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.275827 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.279311 (+ 3484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.280028 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.280033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.280037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.280165 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.280542 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.280545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.280547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.280779 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.280966 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.281317 (+ 351us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.281469 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309}
I20260923 19:47:22.284724 4170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: Bootstrap starting.
I20260923 19:47:22.286080 13667 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 19:47:22.288004 4170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:22.288990 4170 log.cc:824] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:22.288298 3997 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f04fbffee65642169e9b77925286dbc7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59102
I20260923 19:47:22.291802 4170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: No bootstrap required, opened a new log
I20260923 19:47:22.298568 4170 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.298921 4170 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2f12925cdff48649d97eaf0df3a057a, State: Initialized, Role: FOLLOWER
I20260923 19:47:22.299377 4170 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.300244 4177 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.300613 4177 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:22.301358 4170 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:47:22.309993 4188 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:47:22.310130 4188 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:47:22.308454 4103 master_runner.cc:186] Error getting master registration for 127.13.88.254:43067: OK, instance_id { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" instance_seqno: 1790192841217497 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:47:22.319679 4103 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:47:22.355815 4022 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 4
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.254@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
I20260923 19:47:22.372525 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.356650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45712 (local address 127.13.88.252:46011)
0923 19:47:22.356861 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.356866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.356932 (+ 66us) server_negotiation.cc:407] Connection header received
0923 19:47:22.357113 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.357118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.357201 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.357304 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.358295 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.359489 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.361305 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.362030 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.362175 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.366236 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.366241 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.366244 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.366276 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.369733 (+ 3457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.370363 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.370371 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.370375 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.370503 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.370884 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.370890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.370893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.371319 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.371490 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.371948 (+ 458us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.372173 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 19:47:22.372529 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.356595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45712)
0923 19:47:22.356818 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.356843 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:22.356989 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:22.357369 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:22.357375 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:22.357938 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:22.358157 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.358169 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.359650 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.359656 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.361176 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.361191 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.362198 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.362205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.362427 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.363126 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:22.363152 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:22.366032 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:22.369867 (+ 3835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.369872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.369876 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.370238 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.370614 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.370619 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.370622 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.370759 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.371434 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:22.371439 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:22.371652 (+ 213us) client_negotiation.cc:769] Sending connection context
0923 19:47:22.371797 (+ 145us) client_negotiation.cc:240] Negotiation successful
0923 19:47:22.372106 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260923 19:47:22.379086 4022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7: Bootstrap starting.
I20260923 19:47:22.383297 4022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:22.384569 4022 log.cc:824] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:22.388069 4022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7: No bootstrap required, opened a new log
I20260923 19:47:22.395823 4022 raft_consensus.cc:348] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.396258 4022 raft_consensus.cc:729] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f04fbffee65642169e9b77925286dbc7, State: Initialized, Role: FOLLOWER
I20260923 19:47:22.396782 4022 consensus_queue.cc:260] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.397789 4191 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.398164 4191 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:22.399088 4022 sys_catalog.cc:564] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:22.399187 3997 raft_consensus.cc:482] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 19:47:22.399443 3997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:22.402118 3997 raft_consensus.cc:504] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.403586 3997 leader_election.cc:288] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [CANDIDATE]: Term 1 election: Requested vote from peers 98e63066ab3e4633a47fa49230ce6639 (127.13.88.253:35363), a2f12925cdff48649d97eaf0df3a057a (127.13.88.252:46011)
I20260923 19:47:22.404479 4145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f04fbffee65642169e9b77925286dbc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a2f12925cdff48649d97eaf0df3a057a"
I20260923 19:47:22.404965 4145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:22.408419 4145 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f04fbffee65642169e9b77925286dbc7 in term 1.
I20260923 19:47:22.409168 3973 leader_election.cc:302] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2f12925cdff48649d97eaf0df3a057a, f04fbffee65642169e9b77925286dbc7; no voters:
I20260923 19:47:22.409711 4191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:47:22.422989 4191 raft_consensus.cc:686] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [term 1 LEADER]: Becoming Leader. State: Replica: f04fbffee65642169e9b77925286dbc7, State: Running, Role: LEADER
I20260923 19:47:22.424536 4191 consensus_queue.cc:237] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.438978 4096 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } attempt: 5
I20260923 19:47:22.441717 4196 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f04fbffee65642169e9b77925286dbc7. Latest consensus state: current_term: 1 leader_uuid: "f04fbffee65642169e9b77925286dbc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.442227 4196 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: This master's current role is: LEADER
Sep 23 19:47:22 dist-test-slave-xg7f krb5kdc[3942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790192841, etypes {rep=17 tkt=17 ses=17}, kudu/127.13.88.253@KRBTEST.COM for kudu/127.13.88.252@KRBTEST.COM
W20260923 19:47:22.450759 4124 tablet.cc:2369] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:47:22.452265 4206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260923 19:47:22.456359 3976 tablet.cc:2369] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:47:22.457742 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.439587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.13.88.252:46011 (local address 127.0.0.1:45728)
0923 19:47:22.439941 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0923 19:47:22.439960 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 19:47:22.440080 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 19:47:22.441104 (+ 1024us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 19:47:22.441109 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 19:47:22.441651 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0923 19:47:22.441858 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.441869 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.443331 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.443336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.444785 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 19:47:22.444799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.445938 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.445944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 19:47:22.446160 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.446856 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 19:47:22.446879 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 19:47:22.449642 (+ 2763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 19:47:22.454928 (+ 5286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.454935 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.454938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.455478 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.455914 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 19:47:22.455919 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 19:47:22.455922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 19:47:22.456074 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 19:47:22.456768 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 19:47:22.456772 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 19:47:22.456922 (+ 150us) client_negotiation.cc:769] Sending connection context
0923 19:47:22.457074 (+ 152us) client_negotiation.cc:240] Negotiation successful
0923 19:47:22.457359 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234}
I20260923 19:47:22.458715 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.440470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45728 (local address 127.13.88.252:46011)
0923 19:47:22.440658 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.440663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.440683 (+ 20us) server_negotiation.cc:407] Connection header received
0923 19:47:22.440745 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.440750 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.440821 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.440922 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.442035 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.443176 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.444947 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.445629 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.445748 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.449848 (+ 4100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.449855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.449859 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.449896 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.454774 (+ 4878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.455619 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.455626 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.455633 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.455791 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.456203 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.456208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.456211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.456552 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.456709 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.458120 (+ 1411us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.458354 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:47:22.464547 4096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639: Bootstrap starting.
I20260923 19:47:22.468802 4096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639: Neither blocks nor log segments found. Creating new log.
I20260923 19:47:22.470085 4096 log.cc:824] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639: Log is configured to *not* fsync() on all Append() calls
I20260923 19:47:22.479218 4206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 19:47:22.482793 4096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639: No bootstrap required, opened a new log
I20260923 19:47:22.504148 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.437468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59108 (local address 127.13.88.254:43067)
0923 19:47:22.437667 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.437675 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.458577 (+ 20902us) server_negotiation.cc:407] Connection header received
0923 19:47:22.467446 (+ 8869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.467454 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.467542 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.467634 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.479984 (+ 12350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.481131 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.488617 (+ 7486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.489411 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.489519 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.495119 (+ 5600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.495125 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.495129 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.495186 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.498793 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.500499 (+ 1706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.500505 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.500509 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.500697 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.501526 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.501533 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.501537 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.501894 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.502409 (+ 515us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.502718 (+ 309us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.503254 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 19:47:22.508270 4096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.508716 4096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98e63066ab3e4633a47fa49230ce6639, State: Initialized, Role: FOLLOWER
I20260923 19:47:22.509277 4096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } }
I20260923 19:47:22.510900 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.443613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36690 (local address 127.13.88.253:35363)
0923 19:47:22.443808 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.443816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.471170 (+ 27354us) server_negotiation.cc:407] Connection header received
0923 19:47:22.471687 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.471693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.471774 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.471851 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.485586 (+ 13735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.486777 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.490378 (+ 3601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.491115 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.491235 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.502118 (+ 10883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.502125 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.502131 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.502176 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.505782 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.508179 (+ 2397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.508187 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.508193 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.508376 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.508953 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.508958 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.508961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.509339 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.509677 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.510266 (+ 589us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.510524 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 19:47:22.519228 4145 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [term 1 FOLLOWER]: Refusing update from remote peer f04fbffee65642169e9b77925286dbc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:47:22.520349 4196 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:47:22.520802 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.459282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45734 (local address 127.13.88.252:46011)
0923 19:47:22.470862 (+ 11580us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.470869 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.479874 (+ 9005us) server_negotiation.cc:407] Connection header received
0923 19:47:22.483247 (+ 3373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.483266 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.483368 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.483445 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.492251 (+ 8806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.493291 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.497801 (+ 4510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.498594 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.498714 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.513369 (+ 14655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 19:47:22.513378 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 19:47:22.513383 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 19:47:22.513428 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0923 19:47:22.517221 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.518098 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.518103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.518107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.518255 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 19:47:22.518699 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 19:47:22.518705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 19:47:22.518711 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 19:47:22.519159 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 19:47:22.519466 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.520035 (+ 569us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.520293 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11439,"thread_start_us":19042,"threads_started":1}
I20260923 19:47:22.523880 4217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.524298 4217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:22.525261 4096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:47:22.525316 4071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f04fbffee65642169e9b77925286dbc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "98e63066ab3e4633a47fa49230ce6639"
I20260923 19:47:22.525794 4071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:47:22.529175 4071 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f04fbffee65642169e9b77925286dbc7 in term 1.
I20260923 19:47:22.536716 4071 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [term 1 FOLLOWER]: Refusing update from remote peer f04fbffee65642169e9b77925286dbc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:47:22.537695 4196 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:47:22.526654 3955 master_runner.cc:186] Error getting master registration for 127.13.88.253:35363: OK, instance_id { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" instance_seqno: 1790192841714531 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:47:22.540989 3955 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:47:22.548698 4177 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f04fbffee65642169e9b77925286dbc7. Latest consensus state: current_term: 1 leader_uuid: "f04fbffee65642169e9b77925286dbc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.549206 4177 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:22.558542 4214 mvcc.cc:205] Tried to move back new op lower bound from 7332629882937360384 to 7332629882587619328. Current Snapshot: MvccSnapshot[applied={T|T < 7332629882937360384}]
I20260923 19:47:22.568840 4191 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f04fbffee65642169e9b77925286dbc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.569193 4191 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:22.571815 4206 catalog_manager.cc:1347] Generated new cluster ID: 98f3ae1f23df439292eaa6088aff3fe5
I20260923 19:47:22.571915 4206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 19:47:22.576277 4177 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f04fbffee65642169e9b77925286dbc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.576565 4177 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:22.596575 4217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f04fbffee65642169e9b77925286dbc7. Latest consensus state: current_term: 1 leader_uuid: "f04fbffee65642169e9b77925286dbc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.596936 4217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:22.599354 4196 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f04fbffee65642169e9b77925286dbc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.599622 4196 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7 [sys.catalog]: This master's current role is: LEADER
I20260923 19:47:22.606860 4217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f04fbffee65642169e9b77925286dbc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f04fbffee65642169e9b77925286dbc7" member_type: VOTER last_known_addr { host: "127.13.88.254" port: 43067 } } peers { permanent_uuid: "98e63066ab3e4633a47fa49230ce6639" member_type: VOTER last_known_addr { host: "127.13.88.253" port: 35363 } } peers { permanent_uuid: "a2f12925cdff48649d97eaf0df3a057a" member_type: VOTER last_known_addr { host: "127.13.88.252" port: 46011 } } }
I20260923 19:47:22.607208 4217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:47:22.612639 4206 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 19:47:22.614496 4206 catalog_manager.cc:1504] Loading token signing keys...
I20260923 19:47:22.649669 4206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f04fbffee65642169e9b77925286dbc7: Generated new TSK 0
I20260923 19:47:22.650880 4206 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 19:47:22.702780 4236 catalog_manager.cc:1259] Loaded cluster ID: 98f3ae1f23df439292eaa6088aff3fe5
I20260923 19:47:22.702901 4236 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639: loading cluster ID for follower catalog manager: success
I20260923 19:47:22.706566 4236 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639: acquiring CA information for follower catalog manager: success
I20260923 19:47:22.708949 4236 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 98e63066ab3e4633a47fa49230ce6639: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 19:47:22.785928 4026 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:22.760555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.13.88.254:43067)
0923 19:47:22.760754 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.760761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.781726 (+ 20965us) server_negotiation.cc:407] Connection header received
0923 19:47:22.784404 (+ 2678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.784410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.784520 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.784595 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.785686 (+ 1091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59118: BlockingRecv error: recv got EOF from 127.0.0.1:59118 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260923 19:47:22.788604 4100 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:22.766789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36704 (local address 127.13.88.253:35363)
0923 19:47:22.766991 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.767007 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.786900 (+ 19893us) server_negotiation.cc:407] Connection header received
0923 19:47:22.787307 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.787312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.787403 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.787465 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.788368 (+ 903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36704: BlockingRecv error: recv got EOF from 127.0.0.1:36704 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260923 19:47:22.790885 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:22.782270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45740 (local address 127.13.88.252:46011)
0923 19:47:22.782434 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.782440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.789202 (+ 6762us) server_negotiation.cc:407] Connection header received
0923 19:47:22.789602 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.789608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.789700 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.789765 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.790655 (+ 890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45740: BlockingRecv error: recv got EOF from 127.0.0.1:45740 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 19:47:22.843734 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.827808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36708 (local address 127.13.88.253:35363)
0923 19:47:22.827997 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.828003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.835355 (+ 7352us) server_negotiation.cc:407] Connection header received
0923 19:47:22.835907 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.835914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.836145 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.836298 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:22.837011 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.838174 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.840668 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.841337 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.841434 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.842184 (+ 750us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:22.842914 (+ 730us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:22.843033 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.843284 (+ 251us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.843380 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260923 19:47:22.885646 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:22.875679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45742 (local address 127.13.88.252:46011)
0923 19:47:22.875965 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.875971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.883617 (+ 7646us) server_negotiation.cc:407] Connection header received
0923 19:47:22.884122 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.884128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.884258 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.884334 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.885379 (+ 1045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45742: BlockingRecv error: recv got EOF from 127.0.0.1:45742 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
I20260923 19:47:22.916026 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.909181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36718 (local address 127.13.88.253:35363)
0923 19:47:22.909428 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.909435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.909950 (+ 515us) server_negotiation.cc:407] Connection header received
0923 19:47:22.910152 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.910158 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.910257 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.910389 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:22.910864 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.912078 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.913944 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.914635 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.914758 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.915201 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:22.915345 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:22.915449 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.915588 (+ 139us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.915675 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260923 19:47:22.925004 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:22.922703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45756 (local address 127.13.88.252:46011)
0923 19:47:22.922882 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.922888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.923430 (+ 542us) server_negotiation.cc:407] Connection header received
0923 19:47:22.923632 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.923638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.923748 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.923887 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.924745 (+ 858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45756: BlockingRecv error: recv got EOF from 127.0.0.1:45756 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 19:47:22.939702 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.932695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36730 (local address 127.13.88.253:35363)
0923 19:47:22.932883 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.932889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.933383 (+ 494us) server_negotiation.cc:407] Connection header received
0923 19:47:22.933552 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.933558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.933664 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.933759 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:22.934201 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.935400 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.937413 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.938109 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.938232 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.938747 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:22.938906 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:22.938997 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.939245 (+ 248us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.939329 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260923 19:47:22.948964 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:22.946597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45758 (local address 127.13.88.252:46011)
0923 19:47:22.946781 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.946789 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.947347 (+ 558us) server_negotiation.cc:407] Connection header received
0923 19:47:22.947515 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.947521 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.947633 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.947742 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.948727 (+ 985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45758: BlockingRecv error: recv got EOF from 127.0.0.1:45758 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:47:22.963424 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.956813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36746 (local address 127.13.88.253:35363)
0923 19:47:22.957047 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.957053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.957535 (+ 482us) server_negotiation.cc:407] Connection header received
0923 19:47:22.957712 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.957718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.957802 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.957888 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:22.958326 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.959490 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.961344 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.962041 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.962172 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.962643 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:22.962778 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:22.962864 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.963013 (+ 149us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.963093 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
W20260923 19:47:22.971884 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:22.970191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45770 (local address 127.13.88.252:46011)
0923 19:47:22.970476 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.970482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.970503 (+ 21us) server_negotiation.cc:407] Connection header received
0923 19:47:22.970573 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.970578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.970702 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.970798 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:22.971656 (+ 858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45770: BlockingRecv error: recv got EOF from 127.0.0.1:45770 (error 108)
Metrics: {"server-negotiator.queue_time_us":145}
I20260923 19:47:22.989842 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:22.982968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36760 (local address 127.13.88.253:35363)
0923 19:47:22.983168 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:22.983176 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:22.983695 (+ 519us) server_negotiation.cc:407] Connection header received
0923 19:47:22.983877 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:22.983882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:22.983970 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:22.984056 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:22.984801 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.985823 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.987797 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:22.988436 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:22.988549 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:22.989071 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:22.989220 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:22.989306 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:22.989476 (+ 170us) server_negotiation.cc:299] Negotiation successful
0923 19:47:22.989549 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260923 19:47:23.003203 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:23.000858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.13.88.252:46011)
0923 19:47:23.001045 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.001052 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.001583 (+ 531us) server_negotiation.cc:407] Connection header received
0923 19:47:23.001730 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.001736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.001842 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.001956 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:23.002861 (+ 905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45784: BlockingRecv error: recv got EOF from 127.0.0.1:45784 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 19:47:23.033402 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.025841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36764 (local address 127.13.88.253:35363)
0923 19:47:23.026059 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.026070 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.026680 (+ 610us) server_negotiation.cc:407] Connection header received
0923 19:47:23.026933 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.026943 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.027047 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.027219 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.027857 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.029203 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.031216 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.031930 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.032075 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.032603 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.032752 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.032875 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.033008 (+ 133us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.033105 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260923 19:47:23.043339 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:23.041086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45786 (local address 127.13.88.252:46011)
0923 19:47:23.041284 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.041291 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.041788 (+ 497us) server_negotiation.cc:407] Connection header received
0923 19:47:23.041983 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.041988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.042088 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.042199 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:23.043053 (+ 854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45786: BlockingRecv error: recv got EOF from 127.0.0.1:45786 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 19:47:23.085645 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.078694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36766 (local address 127.13.88.253:35363)
0923 19:47:23.078944 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.078950 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.079486 (+ 536us) server_negotiation.cc:407] Connection header received
0923 19:47:23.079746 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.079751 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.079857 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.079955 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.080434 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.081573 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.083546 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.084220 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.084362 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.084794 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.084937 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.085035 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.085196 (+ 161us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.085283 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260923 19:47:23.099589 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:23.097126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45796 (local address 127.13.88.252:46011)
0923 19:47:23.097298 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.097304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.097894 (+ 590us) server_negotiation.cc:407] Connection header received
0923 19:47:23.098092 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.098098 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.098210 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.098334 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:23.099309 (+ 975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45796: BlockingRecv error: recv got EOF from 127.0.0.1:45796 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 19:47:23.173278 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.167662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36770 (local address 127.13.88.253:35363)
0923 19:47:23.167895 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.167902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.168216 (+ 314us) server_negotiation.cc:407] Connection header received
0923 19:47:23.168397 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.168401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.168467 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.168552 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.168943 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.169641 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.171633 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.172068 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.172214 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.172658 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.172752 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.172811 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.172944 (+ 133us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.173003 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260923 19:47:23.181428 4173 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 19:47:23.179520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45806 (local address 127.13.88.252:46011)
0923 19:47:23.179731 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.179737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.180038 (+ 301us) server_negotiation.cc:407] Connection header received
0923 19:47:23.180193 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.180196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.180262 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.180337 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 19:47:23.181161 (+ 824us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45806: BlockingRecv error: recv got EOF from 127.0.0.1:45806 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 19:47:23.312500 4188 catalog_manager.cc:1259] Loaded cluster ID: 98f3ae1f23df439292eaa6088aff3fe5
I20260923 19:47:23.312624 4188 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: loading cluster ID for follower catalog manager: success
I20260923 19:47:23.315364 4188 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: acquiring CA information for follower catalog manager: success
I20260923 19:47:23.317129 4188 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2f12925cdff48649d97eaf0df3a057a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:47:23.318017 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.312882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36782 (local address 127.13.88.253:35363)
0923 19:47:23.313122 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.313129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.313437 (+ 308us) server_negotiation.cc:407] Connection header received
0923 19:47:23.313668 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.313679 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.313749 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.313847 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.314288 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.314984 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.316385 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.316769 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.316895 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.317299 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.317412 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.317503 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.317653 (+ 150us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.317733 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260923 19:47:23.329489 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.323860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45822 (local address 127.13.88.252:46011)
0923 19:47:23.324086 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.324093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.324317 (+ 224us) server_negotiation.cc:407] Connection header received
0923 19:47:23.324509 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.324512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.324701 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.324789 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.325174 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.325944 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.327476 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.327838 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.327934 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.328437 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.328904 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.329006 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.329112 (+ 106us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.329171 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260923 19:47:23.341420 4100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.334775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36790 (local address 127.13.88.253:35363)
0923 19:47:23.335024 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.335033 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.335307 (+ 274us) server_negotiation.cc:407] Connection header received
0923 19:47:23.335570 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.335575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.335659 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.335727 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.336505 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.337570 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.338990 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.339689 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.339807 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.340515 (+ 708us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.340643 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.340730 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.340882 (+ 152us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.340961 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 19:47:23.343436 4173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.335615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45826 (local address 127.13.88.252:46011)
0923 19:47:23.335807 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.335815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.336632 (+ 817us) server_negotiation.cc:407] Connection header received
0923 19:47:23.336779 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.336782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.336835 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.336922 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.338150 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.339137 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.341347 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.341997 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.342116 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.342750 (+ 634us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.342839 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.342907 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.343044 (+ 137us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.343140 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 19:47:23.343899 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 19:47:23.334720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59126 (local address 127.13.88.254:43067)
0923 19:47:23.335444 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0923 19:47:23.335451 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 19:47:23.336278 (+ 827us) server_negotiation.cc:407] Connection header received
0923 19:47:23.336905 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 19:47:23.336911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 19:47:23.337114 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 19:47:23.337278 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 19:47:23.337964 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.339056 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.341315 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 19:47:23.341914 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 19:47:23.341988 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 19:47:23.342808 (+ 820us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 19:47:23.343279 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 19:47:23.343409 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 19:47:23.343509 (+ 100us) server_negotiation.cc:299] Negotiation successful
0923 19:47:23.343588 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":504,"threads_started":1}
I20260923 19:47:23.348299 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 3955
I20260923 19:47:23.349615 4017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:23.457598 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 3955
I20260923 19:47:23.478564 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 4029
I20260923 19:47:23.479650 4091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:23.586643 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 4029
I20260923 19:47:23.606904 13667 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu pid 4103
I20260923 19:47:23.608024 4165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:47:23.715701 13667 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskZLYS4k/build/asan/bin/kudu with pid 4103
2026-09-23T19:47:23Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4296 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9174 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (354388 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST